Apr 16 22:09:31 devstack cinder-volume[72920]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 22:09:31 devstack cinder-volume[72920]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:09:31 devstack cinder-volume[72920]: we strongly recommend against using it for new projects. Apr 16 22:09:31 devstack cinder-volume[72920]: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:09:31 devstack cinder-volume[72920]: framework. For more detail see Apr 16 22:09:31 devstack cinder-volume[72920]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:09:31 devstack cinder-volume[72920]: import eventlet # noqa Apr 16 22:09:33 devstack cinder-volume[72920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:09:33 devstack cinder-volume[72920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:09:33 devstack cinder-volume[72920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:09:34 devstack cinder-volume[72920]: INFO dbcounter [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Registered counter for database cinder Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_db.sqlalchemy.engines [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72920) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG dbcounter [-] [72920] Writer thread running {{(pid=72920) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:09:34 devstack cinder-volume[72920]: INFO cinder.rpc [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 22:09:34 devstack cinder-volume[72920]: INFO cinder.rpc [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_db.sqlalchemy.engines [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72920) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:09:34 devstack cinder-volume[72920]: INFO cinder.volume.manager [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Determined volume DB was empty at startup. Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG cinder.volume.manager [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72920) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 16 22:09:34 devstack cinder-volume[72920]: INFO cinder.volume.manager [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 22:09:34 devstack cinder-volume[72920]: WARNING stevedore.named [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 22:09:34 devstack cinder-volume[72920]: WARNING castellan.key_manager [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:09:34 devstack cinder-volume[72920]: WARNING cinder.keymgr.conf_key_mgr [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG cinder.volume.drivers.lvm [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72920) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_concurrency.processutils [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72920) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_concurrency.processutils [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.271s {{(pid=72920) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_db.sqlalchemy.engines [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72920) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:09:34 devstack cinder-volume[72920]: INFO cinder.rpc [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 16 22:09:34 devstack cinder-volume[72920]: INFO cinder.rpc [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 16 22:09:34 devstack cinder-volume[72920]: WARNING stevedore.named [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 22:09:34 devstack cinder-volume[72920]: WARNING castellan.key_manager [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:09:34 devstack cinder-volume[72920]: INFO cinder.volume.manager [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_db.sqlalchemy.engines [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72920) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:09:34 devstack cinder-volume[72920]: INFO oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Starting 1 workers Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Started child 73026 {{(pid=72920) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Full set of CONF: {{(pid=72920) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] ******************************************************************************** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Configuration options gathered from: {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 22:09:34 devstack cinder-volume[73026]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] ================================================================================ {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] allow_availability_zone_fallback = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] allow_compression_on_image_upload = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] allowed_direct_url_schemes = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] api_rate_limit = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] auth_strategy = keystone {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] az_cache_duration = 3600 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_availability_zone = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_host = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_stats_polling_interval = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backup_api_class = cinder.backup.api.API {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backup_name_template = backup-%s {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backup_use_same_host = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backup_use_temp_snapshot = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] chap_password = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] chap_username = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_internal_tenant_project_id = c403c181b5374aca8906d9019d9d9f69 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_internal_tenant_user_id = a61d4b9709bf42db97a1da2c5f4b844f {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cloned_volume_same_az = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cluster = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] compression_format = gzip {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] compute_api_class = cinder.compute.nova.API {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] config_dir = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] config_source = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] control_exchange = openstack {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] debug = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] default_availability_zone = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] default_group_type = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] default_volume_type = lvmdriver-1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] disk_geometry = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] driver_client_cert = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] driver_client_cert_key = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] driver_data_namespace = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] driver_ssl_cert_path = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] driver_ssl_cert_verify = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] driver_use_ssl = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] enable_force_upload = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] enable_new_services = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] enable_unsupported_driver = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] enforce_multipath_for_image_xfer = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] filter_function = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_api_insecure = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_api_ssl_compression = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_ca_certificates_file = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_catalog_info = image:glance:publicURL {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_certfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_keyfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_num_retries = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[73026]: INFO cinder.volume.manager [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance_request_timeout = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] goodness_function = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] graceful_shutdown_timeout = 5 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] group_api_class = cinder.group.api.API {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] host = devstack {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_compress_on_upload = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_conversion_address_space_limit = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_conversion_cpu_limit = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_conversion_disable = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_upload_use_cinder_backend = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_upload_use_internal_tenant = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_volume_cache_enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_volume_cache_max_count = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] image_volume_cache_max_size_gb = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] init_host_max_objects_retrieval = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] instance_format = [instance: %(uuid)s] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] iscsi_target_flags = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] iscsi_write_cache = on {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] iser_helper = tgtadm {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] iser_ip_address = 192.168.122.24 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] iser_port = 3260 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_color = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_config_append = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_dir = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_file = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_options = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_rotate_interval = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_rotate_interval_type = days {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] log_rotation_type = none {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] max_age = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] max_logfile_count = 30 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] max_logfile_size_mb = 200 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] max_over_subscription_ratio = 20.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] message_reap_interval = 86400 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] message_ttl = 2592000 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] migration_create_volume_timeout_secs = 300 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] monkey_patch = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] monkey_patch_modules = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] my_ip = 192.168.122.24 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] no_snapshot_gb_quota = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] num_iser_scan_tries = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] num_shell_tries = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] num_volume_device_scan_tries = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] nvmeof_conn_info_version = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] nvmet_ns_id = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] nvmet_port_id = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] osapi_max_limit = 1000 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] osapi_volume_ext_list = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] osapi_volume_listen_port = 8776 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] osapi_volume_use_ssl = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] osapi_volume_workers = 2 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] per_volume_size_limit = -1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] periodic_fuzzy_delay = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] periodic_interval = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] public_endpoint = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] publish_errors = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] quota_backup_gigabytes = 1000 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] quota_backups = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] quota_gigabytes = 1000 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] quota_groups = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] quota_snapshots = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] quota_volumes = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] rate_limit_burst = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] rate_limit_except_level = CRITICAL {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] rate_limit_interval = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] reinit_driver_count = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] replication_device = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] report_discard_supported = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] report_interval = 120 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] reservation_clean_interval = 86400 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] reservation_expire = 86400 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] reserved_image_namespaces = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] reserved_percentage = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] rpc_response_timeout = 120 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] run_external_periodic_tasks = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] scst_target_driver = iscsi {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] scst_target_iqn_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_down_time = 720 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] shell_completion = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] snapshot_name_template = snapshot-%s {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] snapshot_same_host = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] split_loggers = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] state_path = /opt/stack/data/cinder {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] storage_availability_zone = nova {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] storage_protocol = iSCSI {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] syslog_log_facility = LOG_USER {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] target_helper = lioadm {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] target_ip_address = 192.168.122.24 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] target_port = 3260 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] target_protocol = iscsi {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] target_secondary_ip_addresses = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] trace_flags = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] transport_url = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] until_refresh = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] use_chap_auth = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] use_default_quota_class = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] use_journal = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] use_json = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] use_multipath_for_image_xfer = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] use_stderr = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] use_syslog = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] verify_glance_signatures = enabled {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_api_class = cinder.volume.api.API {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_backend_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_clear = zero {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_clear_ionice = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_clear_size = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_copy_bps_limit = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_dd_blocksize = 1M {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_name_template = volume-%s {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_service_inithost_offload = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volume_usage_audit_period = month {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] zoning_mode = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_concurrency.disable_process_locking = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.admin_password = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.admin_token = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.admin_user = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.auth_port = 35357 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.auth_protocol = https {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.auth_section = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.auth_type = password {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.auth_uri = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.auth_version = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.cache = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.certfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.identity_uri = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.include_service_catalog = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.insecure = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.interface = public {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.keyfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_password = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcache_username = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.region_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.service_type = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.backend = dogpile.cache.null {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.backend_argument = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.backend_expiration_time = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.config_prefix = cache.oslo {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.debug_cache_backend = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.enable_retry_client = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.enable_socket_keepalive = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.enforce_fips_mode = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.expiration_time = 600 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.hashclient_retry_attempts = 2 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.memcache_dead_retry = 300 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.memcache_pool_maxsize = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.memcache_sasl_enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.password = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.proxies = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.redis_db = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.redis_server = localhost:6379 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.retry_attempts = 2 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.retry_delay = 0.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.socket_keepalive_count = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.socket_keepalive_idle = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.socket_keepalive_interval = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.socket_timeout = 1.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.tls_allowed_ciphers = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.tls_cafile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.tls_certfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.tls_enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.tls_keyfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cache.username = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] coordination.backend_url = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.asyncio_connection = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.asyncio_slave_connection = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.backend = sqlalchemy {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.connection = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.connection_debug = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.connection_parameters = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.connection_recycle_time = 3600 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.connection_trace = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.db_inc_retry_interval = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.db_max_retries = 20 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.db_max_retry_interval = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.db_retry_interval = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.max_overflow = 50 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.max_pool_size = 5 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.max_retries = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.mysql_wsrep_sync_wait = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.pool_timeout = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.retry_interval = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.slave_connection = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:34 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.sqlite_synchronous = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.synchronous_reader = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] database.use_db_reconnect = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.connection_string = messaging:// {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.es_doc_type = notification {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.es_scroll_size = 10000 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.es_scroll_time = 2m {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack sudo[73030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.filter_error_trace = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack sudo[73030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.hmac_keys = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.sentinel_service_name = mymaster {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.socket_timeout = 0.1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.trace_requests = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler.trace_sqlalchemy = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler_jaeger.process_tags = {} {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler_jaeger.service_name_prefix = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] profiler_otlp.service_name_prefix = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.enforce_new_defaults = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: WARNING oslo_config.cfg [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.enforce_scope = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.policy_default_rule = default {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.policy_file = policy.yaml {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] privsep_osbrick.group = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] privsep_osbrick.helper_command = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] privsep_osbrick.user = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_sys_admin.group = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_sys_admin.helper_command = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] cinder_sys_admin.user = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.auth_section = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.auth_type = password {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.cafile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.certfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.collect_timing = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.insecure = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.keyfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.send_service_user_token = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.split_loggers = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] service_user.timeout = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.auth_section = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.auth_type = password {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.certfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.collect_timing = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.insecure = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.keyfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.region_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.split_loggers = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] glance.timeout = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.backend_availability_zone = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.chap_password = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.chap_username = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.disk_geometry = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.driver_client_cert = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.driver_client_cert_key = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.driver_data_namespace = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.driver_use_ssl = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.extra_capabilities = {} {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.filter_function = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.goodness_function = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.iscsi_target_flags = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.iscsi_write_cache = on {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.iser_helper = tgtadm {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.iser_port = 3260 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.lvm_share_target = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.lvm_type = auto {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.num_shell_tries = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.replication_device = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.report_discard_supported = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.reserved_percentage = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.target_helper = tgtadm {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.target_port = 3260 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.target_protocol = iscsi {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.trace_flags = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.unique_fqdn_network = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.use_chap_auth = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_backend_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_clear = zero {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_clear_ionice = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_clear_size = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_reports.file_event_handler = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_reports.log_dir = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.backend_host = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.chap_password = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.chap_username = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.disk_geometry = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.driver_client_cert = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.extra_capabilities = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.filter_function = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.goodness_function = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.iser_helper = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.iser_ip_address = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.iser_port = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.lvm_share_target = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.lvm_type = auto {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.num_shell_tries = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.replication_device = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.report_discard_supported = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.reserved_percentage = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.scst_target_driver = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.storage_protocol = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.target_helper = lioadm {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.target_ip_address = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.target_port = 3260 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.trace_flags = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.use_chap_auth = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_clear = zero {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_clear_size = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] lvmdriver-1.volumes_dir = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.ssl = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_notifications.driver = [] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_notifications.retry = -1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] key_manager.fixed_key = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.barbican_api_version = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.barbican_endpoint = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.barbican_endpoint_type = public {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.barbican_region_name = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.cafile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.certfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.collect_timing = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.insecure = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.keyfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.number_of_retries = 60 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.retry_delay = 1 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.send_service_user_token = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.split_loggers = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.timeout = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.verify_ssl = True {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican.verify_ssl_path = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.auth_section = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.auth_type = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.cafile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.certfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.collect_timing = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.insecure = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.keyfile = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.split_loggers = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] barbican_service_user.timeout = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.approle_role_id = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.approle_secret_id = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.kv_mountpoint = secret {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.kv_path = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.kv_version = 2 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.namespace = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.root_token_id = **** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.ssl_ca_crt_file = None {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.timeout = 60.0 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.use_ssl = False {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:09:35 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] ******************************************************************************** {{(pid=72920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 22:09:35 devstack sudo[73030]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:35 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:35 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:35 devstack sudo[73223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:35 devstack sudo[73223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:36 devstack sudo[73223]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:36 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.626s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:36 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:09:36 devstack cinder-volume[73026]: INFO cinder.brick.local_dev.lvm [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 16 22:09:36 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:36 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:36 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:36 devstack sudo[73512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:09:36 devstack sudo[73512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:36 devstack sudo[73512]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:36 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:36 devstack cinder-volume[73026]: DEBUG cinder.brick.local_dev.lvm [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73026) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 16 22:09:36 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:36 devstack sudo[73557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:36 devstack sudo[73557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:37 devstack sudo[73557]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:37 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.837s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:37 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:37 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:37 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:37 devstack sudo[73715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:37 devstack sudo[73715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:38 devstack sudo[73715]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:38 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:38 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:38 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:38 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:38 devstack sudo[73724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 16 22:09:38 devstack sudo[73724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:38 devstack sudo[73724]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:38 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.471s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:38 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:38 devstack sudo[73728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:09:38 devstack sudo[73728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:39 devstack sudo[73728]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:39 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:39 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:39 devstack sudo[73733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:09:39 devstack sudo[73733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:39 devstack sudo[73733]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:39 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:39 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:39 devstack sudo[73737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:09:39 devstack sudo[73737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:40 devstack sudo[73737]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:40 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.543s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:40 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:40 devstack sudo[73750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:40 devstack sudo[73750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:40 devstack sudo[73750]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:40 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.496s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:40 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:40 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:40 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:40 devstack sudo[73754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:40 devstack sudo[73754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:41 devstack sudo[73754]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:41 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.551s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:41 devstack cinder-volume[73026]: INFO cinder.volume.drivers.lvm [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 16 22:09:41 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:41 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:41 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:41 devstack sudo[73848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:41 devstack sudo[73848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:42 devstack sudo[73848]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:42 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:42 devstack cinder-volume[73026]: DEBUG cinder.volume.drivers.lvm [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Updating volume stats {{(pid=73026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:09:42 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:42 devstack sudo[73953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:09:42 devstack sudo[73953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:42 devstack sudo[73953]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:42 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.547s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:42 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:42 devstack sudo[74016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:09:42 devstack sudo[74016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:43 devstack sudo[74016]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:43 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:43 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:43 devstack sudo[74021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:43 devstack sudo[74021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:43 devstack sudo[74021]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:43 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:43 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:43 devstack sudo[74024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:09:43 devstack sudo[74024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:44 devstack sudo[74024]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.541s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:44 devstack cinder-volume[73026]: INFO cinder.volume.driver [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG cinder.volume.driver [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73026) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG oslo_db.sqlalchemy.engines [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73026) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG dbcounter [-] [73026] Writer thread running {{(pid=73026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG cinder.db.sqlalchemy.api [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Building query based on filter {{(pid=73026) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG cinder.image.image_utils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73026) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 22:09:44 devstack cinder-volume[73026]: INFO cinder.keymgr.migration [None req-6d15ab22-9255-4d64-abef-ec8180e66098 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG cinder.volume.drivers.lvm [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Updating volume stats {{(pid=73026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:44 devstack sudo[74029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:09:44 devstack sudo[74029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:44 devstack sudo[74029]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:44 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:44 devstack sudo[74032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:09:44 devstack sudo[74032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:44 devstack cinder-volume[72920]: DEBUG dbcounter [-] [72920] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72920) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:09:45 devstack sudo[74032]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:45 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.530s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:45 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:45 devstack sudo[74041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:45 devstack sudo[74041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:45 devstack sudo[74041]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:45 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.594s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:45 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:45 devstack sudo[74045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:09:45 devstack sudo[74045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:46 devstack sudo[74045]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:46 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.550s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:46 devstack cinder-volume[73026]: DEBUG cinder.manager [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Notifying Schedulers of capabilities ... {{(pid=73026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:09:46 devstack cinder-volume[73026]: INFO cinder.volume.manager [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Driver initialization completed successfully. Apr 16 22:09:46 devstack cinder-volume[73026]: INFO cinder.manager [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Initiating service 2 cleanup Apr 16 22:09:46 devstack cinder-volume[73026]: INFO cinder.manager [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Service 2 cleanup completed. Apr 16 22:09:46 devstack cinder-volume[73026]: DEBUG cinder.service [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Creating RPC server for service cinder-volume {{(pid=73026) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 22:09:46 devstack cinder-volume[73026]: DEBUG cinder.service [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73026) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 22:09:46 devstack cinder-volume[73026]: INFO cinder.volume.manager [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 16 22:09:46 devstack cinder-volume[73026]: DEBUG cinder.volume.drivers.lvm [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Updating volume stats {{(pid=73026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:09:46 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:46 devstack sudo[74048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:09:46 devstack sudo[74048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:46 devstack sudo[74048]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:46 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:46 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:46 devstack sudo[74105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:09:46 devstack sudo[74105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:47 devstack sudo[74105]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:47 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:47 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:47 devstack sudo[74111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:09:47 devstack sudo[74111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:47 devstack sudo[74111]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:47 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:47 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:09:47 devstack sudo[74114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:09:47 devstack sudo[74114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:09:48 devstack sudo[74114]: pam_unix(sudo:session): session closed for user root Apr 16 22:09:48 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:09:48 devstack cinder-volume[73026]: INFO cinder.volume.manager [None req-510b2762-dc99-44d7-9a05-869d61e3f2f9 None None] Driver post RPC initialization completed successfully. Apr 16 22:09:56 devstack cinder-volume[73026]: DEBUG dbcounter [-] [73026] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:09:58 devstack cinder-volume[73026]: DEBUG dbcounter [-] [73026] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:10:14 devstack cinder-volume[73026]: DEBUG oslo_service.periodic_task [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running periodic task VolumeManager._thread_info {{(pid=73026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:10:14 devstack cinder-volume[73026]: DEBUG cinder.volume.manager [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] thread count: 6 {{(pid=73026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:10:14 devstack cinder-volume[73026]: DEBUG cinder.volume.manager [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] thread info: [<_MainThread(MainThread, started 139827952467968)>, , , , , ] {{(pid=73026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:11:14 devstack cinder-volume[73026]: DEBUG oslo_service.periodic_task [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:11:14 devstack cinder-volume[73026]: DEBUG cinder.volume.drivers.lvm [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Updating volume stats {{(pid=73026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:11:14 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:11:14 devstack sudo[79050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:11:14 devstack sudo[79050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:11:14 devstack sudo[79050]: pam_unix(sudo:session): session closed for user root Apr 16 22:11:14 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:11:14 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:11:14 devstack sudo[79087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:11:14 devstack sudo[79087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:11:15 devstack sudo[79087]: pam_unix(sudo:session): session closed for user root Apr 16 22:11:15 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:11:15 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:11:15 devstack sudo[79130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:11:15 devstack sudo[79130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:11:15 devstack sudo[79130]: pam_unix(sudo:session): session closed for user root Apr 16 22:11:15 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:11:15 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:11:15 devstack sudo[79138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:11:15 devstack sudo[79138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:11:16 devstack sudo[79138]: pam_unix(sudo:session): session closed for user root Apr 16 22:11:16 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:11:16 devstack cinder-volume[73026]: DEBUG cinder.manager [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Notifying Schedulers of capabilities ... {{(pid=73026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:11:16 devstack cinder-volume[73026]: DEBUG oslo_service.periodic_task [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running periodic task VolumeManager._thread_info {{(pid=73026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:11:16 devstack cinder-volume[73026]: DEBUG cinder.volume.manager [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] thread count: 6 {{(pid=73026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:11:16 devstack cinder-volume[73026]: DEBUG cinder.volume.manager [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] thread info: [<_MainThread(MainThread, started 139827952467968)>, , , , , ] {{(pid=73026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:11:58 devstack cinder-volume[73026]: DEBUG dbcounter [-] [73026] Writing DB stats cinder:SELECT=1 {{(pid=73026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:11:58 devstack cinder-volume[73026]: DEBUG dbcounter [-] [73026] Writing DB stats cinder:UPDATE=1 {{(pid=73026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:12:14 devstack cinder-volume[73026]: DEBUG oslo_service.periodic_task [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:12:14 devstack cinder-volume[73026]: DEBUG cinder.volume.drivers.lvm [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Updating volume stats {{(pid=73026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:12:14 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:12:14 devstack sudo[80913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:12:14 devstack sudo[80913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:12:14 devstack sudo[80913]: pam_unix(sudo:session): session closed for user root Apr 16 22:12:14 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:12:14 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:12:14 devstack sudo[80916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:12:14 devstack sudo[80916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:12:15 devstack sudo[80916]: pam_unix(sudo:session): session closed for user root Apr 16 22:12:15 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:12:15 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:12:15 devstack sudo[80930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:12:15 devstack sudo[80930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:12:15 devstack sudo[80930]: pam_unix(sudo:session): session closed for user root Apr 16 22:12:15 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:12:15 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:12:15 devstack sudo[80933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:12:15 devstack sudo[80933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:12:16 devstack sudo[80933]: pam_unix(sudo:session): session closed for user root Apr 16 22:12:16 devstack cinder-volume[73026]: DEBUG oslo_concurrency.processutils [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:12:16 devstack cinder-volume[73026]: DEBUG cinder.manager [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Notifying Schedulers of capabilities ... {{(pid=73026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:12:16 devstack cinder-volume[73026]: DEBUG oslo_service.periodic_task [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] Running periodic task VolumeManager._thread_info {{(pid=73026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:12:16 devstack cinder-volume[73026]: DEBUG cinder.volume.manager [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] thread count: 6 {{(pid=73026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:12:16 devstack cinder-volume[73026]: DEBUG cinder.volume.manager [None req-22ec2ae7-a027-4ede-b3a9-f4adb25dc19d None None] thread info: [<_MainThread(MainThread, started 139827952467968)>, , , , , ] {{(pid=73026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:13:10 devstack cinder-volume[72920]: INFO oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Caught SIGTERM, stopping children Apr 16 22:13:10 devstack cinder-volume[72920]: DEBUG oslo_concurrency.lockutils [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Acquiring lock "singleton_lock" {{(pid=72920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:13:10 devstack cinder-volume[72920]: DEBUG oslo_concurrency.lockutils [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Acquired lock "singleton_lock" {{(pid=72920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:13:10 devstack cinder-volume[72920]: DEBUG oslo_concurrency.lockutils [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Releasing lock "singleton_lock" {{(pid=72920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:13:10 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Stop services. {{(pid=72920) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 22:13:10 devstack cinder-volume[72920]: DEBUG oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Killing children. {{(pid=72920) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 22:13:10 devstack cinder-volume[72920]: INFO oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Waiting on 1 children to exit Apr 16 22:13:11 devstack cinder-volume[73026]: DEBUG oslo_concurrency.lockutils [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Acquiring lock "singleton_lock" {{(pid=73026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:13:11 devstack cinder-volume[73026]: DEBUG oslo_concurrency.lockutils [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Acquired lock "singleton_lock" {{(pid=73026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:13:11 devstack cinder-volume[73026]: DEBUG oslo_concurrency.lockutils [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Releasing lock "singleton_lock" {{(pid=73026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:13:11 devstack cinder-volume[73026]: WARNING amqp [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 22:13:11 devstack cinder-volume[73026]: WARNING amqp [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 22:13:11 devstack cinder-volume[72920]: INFO oslo_service.backend._eventlet.service [None req-233bfa7e-29a4-4320-a19a-be237d2474b9 None None] Child 73026 exited with status 0 Apr 16 22:13:11 devstack cinder-volume[82109]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 22:13:11 devstack cinder-volume[82109]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:13:11 devstack cinder-volume[82109]: we strongly recommend against using it for new projects. Apr 16 22:13:11 devstack cinder-volume[82109]: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:13:11 devstack cinder-volume[82109]: framework. For more detail see Apr 16 22:13:11 devstack cinder-volume[82109]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:13:11 devstack cinder-volume[82109]: import eventlet # noqa Apr 16 22:13:13 devstack cinder-volume[82109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:13:13 devstack cinder-volume[82109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:13:13 devstack cinder-volume[82109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:13:14 devstack cinder-volume[82109]: INFO dbcounter [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Registered counter for database cinder Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_db.sqlalchemy.engines [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG dbcounter [-] [82109] Writer thread running {{(pid=82109) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:13:14 devstack cinder-volume[82109]: INFO cinder.rpc [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 22:13:14 devstack cinder-volume[82109]: INFO cinder.rpc [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_db.sqlalchemy.engines [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:13:14 devstack cinder-volume[82109]: INFO cinder.volume.manager [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Determined volume DB was empty at startup. Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG cinder.volume.manager [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82109) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 16 22:13:14 devstack cinder-volume[82109]: INFO cinder.volume.manager [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 22:13:14 devstack cinder-volume[82109]: WARNING stevedore.named [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 22:13:14 devstack cinder-volume[82109]: WARNING castellan.key_manager [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:13:14 devstack cinder-volume[82109]: WARNING cinder.keymgr.conf_key_mgr [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:13:14 devstack cinder-volume[82109]: INFO cinder.volume.manager [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_db.sqlalchemy.engines [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:13:14 devstack cinder-volume[82109]: INFO oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Starting 1 workers Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Started child 82231 {{(pid=82109) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Full set of CONF: {{(pid=82109) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] ******************************************************************************** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Configuration options gathered from: {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] ================================================================================ {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] allow_availability_zone_fallback = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] allow_compression_on_image_upload = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82231]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] allowed_direct_url_schemes = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] api_rate_limit = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] auth_strategy = keystone {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_availability_zone = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_host = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_stats_polling_interval = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backup_api_class = cinder.backup.api.API {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backup_name_template = backup-%s {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backup_use_same_host = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backup_use_temp_snapshot = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] chap_password = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] chap_username = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_internal_tenant_project_id = c403c181b5374aca8906d9019d9d9f69 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_internal_tenant_user_id = a61d4b9709bf42db97a1da2c5f4b844f {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cluster = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] compression_format = gzip {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] compute_api_class = cinder.compute.nova.API {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] config_dir = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] config_source = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] control_exchange = openstack {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] debug = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] default_availability_zone = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] default_group_type = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] default_volume_type = QuobyteHD {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] disk_geometry = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] driver_client_cert = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] driver_client_cert_key = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] driver_data_namespace = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] driver_ssl_cert_path = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] driver_ssl_cert_verify = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] driver_use_ssl = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] enable_new_services = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] enable_unsupported_driver = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] enabled_backends = ['QuobyteHD'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] enforce_multipath_for_image_xfer = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] filter_function = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_api_insecure = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_api_ssl_compression = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_ca_certificates_file = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_catalog_info = image:glance:publicURL {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_certfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_keyfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_num_retries = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance_request_timeout = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] goodness_function = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] graceful_shutdown_timeout = 5 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] group_api_class = cinder.group.api.API {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] host = devstack {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_compress_on_upload = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_conversion_address_space_limit = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_conversion_cpu_limit = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_conversion_disable = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_upload_use_cinder_backend = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_upload_use_internal_tenant = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_volume_cache_enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_volume_cache_max_count = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] image_volume_cache_max_size_gb = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] init_host_max_objects_retrieval = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] instance_format = [instance: %(uuid)s] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] iscsi_target_flags = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] iscsi_write_cache = on {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] iser_helper = tgtadm {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] iser_ip_address = 192.168.122.24 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] iser_port = 3260 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_color = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_config_append = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_dir = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_file = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_options = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_rotate_interval = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_rotate_interval_type = days {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] log_rotation_type = none {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] max_age = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] max_logfile_count = 30 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] max_logfile_size_mb = 200 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] max_over_subscription_ratio = 20.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] message_reap_interval = 86400 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] message_ttl = 2592000 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] migration_create_volume_timeout_secs = 300 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] monkey_patch = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] monkey_patch_modules = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] my_ip = 192.168.122.24 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] no_snapshot_gb_quota = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] num_iser_scan_tries = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] num_shell_tries = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] num_volume_device_scan_tries = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] nvmeof_conn_info_version = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] nvmet_ns_id = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] nvmet_port_id = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] osapi_max_limit = 1000 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] osapi_volume_ext_list = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82231]: INFO cinder.volume.manager [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] osapi_volume_listen = 0.0.0.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] osapi_volume_listen_port = 8776 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] osapi_volume_use_ssl = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.remotefs [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82231) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] osapi_volume_workers = 2 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] per_volume_size_limit = -1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] periodic_fuzzy_delay = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] periodic_interval = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] project_id_regex = [0-9a-f\-]+ {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] public_endpoint = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] publish_errors = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] quota_backup_gigabytes = 1000 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] quota_backups = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] quota_gigabytes = 1000 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] quota_groups = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] quota_snapshots = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] quota_volumes = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] rate_limit_burst = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] rate_limit_except_level = CRITICAL {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] rate_limit_interval = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] reinit_driver_count = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] replication_device = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] report_discard_supported = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] report_interval = 120 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] reservation_clean_interval = 86400 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] reservation_expire = 86400 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] reserved_image_namespaces = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] reserved_percentage = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] rpc_response_timeout = 120 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] run_external_periodic_tasks = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] scst_target_driver = iscsi {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] scst_target_iqn_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_down_time = 720 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] shell_completion = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] snapshot_name_template = snapshot-%s {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] split_loggers = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] state_path = /opt/stack/data/cinder {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] storage_availability_zone = nova {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] storage_protocol = iSCSI {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] syslog_log_facility = LOG_USER {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] target_helper = lioadm {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] target_ip_address = 192.168.122.24 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] target_port = 3260 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] target_protocol = iscsi {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] target_secondary_ip_addresses = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] trace_flags = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] transfer_api_class = cinder.transfer.api.API {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] transport_url = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] until_refresh = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] use_chap_auth = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] use_default_quota_class = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] use_journal = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] use_json = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] use_multipath_for_image_xfer = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] use_stderr = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] use_syslog = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] verify_glance_signatures = enabled {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_api_class = cinder.volume.api.API {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_backend_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_clear = zero {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_clear_ionice = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_clear_size = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_copy_bps_limit = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_dd_blocksize = 1M {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_name_template = volume-%s {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_service_inithost_offload = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volume_usage_audit_period = month {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] zoning_mode = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_concurrency.disable_process_locking = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.admin_password = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.admin_token = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.admin_user = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.auth_admin_prefix = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.auth_port = 35357 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.auth_protocol = https {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.auth_section = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.auth_type = password {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.auth_uri = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.auth_version = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.cache = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.certfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.delay_auth_decision = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.http_connect_timeout = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.identity_uri = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.include_service_catalog = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.insecure = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.interface = public {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.keyfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_password = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcache_username = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.region_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.service_token_roles_required = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.service_type = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.token_cache_time = 300 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.backend = dogpile.cache.null {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.backend_argument = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.backend_expiration_time = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.config_prefix = cache.oslo {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.debug_cache_backend = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.enable_retry_client = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.enable_socket_keepalive = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.enforce_fips_mode = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.expiration_time = 600 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.hashclient_retry_attempts = 2 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.memcache_dead_retry = 300 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.memcache_pool_maxsize = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.memcache_sasl_enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.password = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.proxies = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.redis_db = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.redis_sentinel_service_name = mymaster {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.redis_server = localhost:6379 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.retry_attempts = 2 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.retry_delay = 0.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.socket_keepalive_count = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.socket_keepalive_idle = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.socket_keepalive_interval = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.socket_timeout = 1.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.tls_allowed_ciphers = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.tls_cafile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.tls_certfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.tls_enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.tls_keyfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cache.username = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] coordination.backend_url = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.asyncio_connection = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.asyncio_slave_connection = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.backend = sqlalchemy {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.connection = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.connection_debug = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.connection_parameters = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.connection_recycle_time = 3600 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.connection_trace = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.db_inc_retry_interval = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.db_max_retries = 20 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.db_max_retry_interval = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.db_retry_interval = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.max_overflow = 50 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.max_pool_size = 5 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.max_retries = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.mysql_wsrep_sync_wait = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.pool_timeout = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.retry_interval = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.slave_connection = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.sqlite_synchronous = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.synchronous_reader = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] database.use_db_reconnect = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.connection_string = messaging:// {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.es_doc_type = notification {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.es_scroll_size = 10000 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.es_scroll_time = 2m {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.filter_error_trace = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.hmac_keys = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.sentinel_service_name = mymaster {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.socket_timeout = 0.1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.trace_requests = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler.trace_sqlalchemy = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler_jaeger.process_tags = {} {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler_jaeger.service_name_prefix = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] profiler_otlp.service_name_prefix = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.enforce_new_defaults = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: WARNING oslo_config.cfg [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.enforce_scope = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.policy_default_rule = default {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.policy_file = policy.yaml {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_policy.remote_timeout = 60.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] privsep_osbrick.group = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] privsep_osbrick.helper_command = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] privsep_osbrick.user = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_sys_admin.group = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_sys_admin.helper_command = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] cinder_sys_admin.user = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.auth_section = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.auth_type = password {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.cafile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.certfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.collect_timing = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.insecure = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.keyfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.send_service_user_token = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.split_loggers = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] service_user.timeout = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.auth_section = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82231) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.auth_type = password {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82231]: WARNING cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82231]: WARNING cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.certfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.collect_timing = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.insecure = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.keyfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.region_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.split_loggers = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] glance.timeout = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Running cmd (subprocess): mount.quobyte {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.backend_availability_zone = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.chap_password = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.chap_username = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.disk_geometry = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.driver_client_cert = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.driver_client_cert_key = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.driver_data_namespace = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.driver_use_ssl = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.enable_unsupported_driver = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.extra_capabilities = {} {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.filter_function = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.goodness_function = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.iscsi_target_flags = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.iscsi_write_cache = on {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.iser_helper = tgtadm {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.iser_port = 3260 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_host = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_login = admin {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_mount_options = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_password = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_private_key = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_share_path = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_ssh_port = 22 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.num_shell_tries = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.nvmet_port_id = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.quobyte_client_cfg = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.quobyte_volume_url = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.replication_device = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.report_discard_supported = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.reserved_percentage = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.scst_target_driver = iscsi {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.scst_target_iqn_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.storage_protocol = iSCSI {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.target_helper = tgtadm {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.target_port = 3260 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.target_protocol = iscsi {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.trace_flags = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.unique_fqdn_network = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.use_chap_auth = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volume_backend_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volume_clear = zero {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volume_clear_ionice = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volume_clear_size = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_reports.file_event_handler = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_reports.log_dir = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.backend_availability_zone = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.backend_host = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.chap_password = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.chap_username = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.chiscsi_conf = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.disk_geometry = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.driver_client_cert = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.driver_client_cert_key = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.driver_data_namespace = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.driver_use_ssl = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.extra_capabilities = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.filter_function = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.goodness_function = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.iscsi_target_flags = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.iscsi_write_cache = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.iser_helper = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.iser_ip_address = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.iser_port = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.iser_target_prefix = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_host = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_login = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_mount_options = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_password = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_private_key = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_share_path = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_ssh_port = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.num_shell_tries = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nvmet_ns_id = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.nvmet_port_id = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.replication_device = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.report_discard_supported = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.reserved_percentage = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.scst_target_driver = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.storage_protocol = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.target_helper = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.target_ip_address = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.target_port = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.target_prefix = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.target_protocol = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.trace_flags = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.unique_fqdn_network = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.use_chap_auth = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volume_clear = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volume_clear_ionice = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volume_clear_size = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] QuobyteHD.volumes_dir = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.ssl = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.ssl_version = {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_notifications.driver = [] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_notifications.retry = -1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] oslo_messaging_notifications.transport_url = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] key_manager.fixed_key = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.barbican_api_version = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.barbican_endpoint = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.barbican_endpoint_type = public {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.barbican_region_name = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.cafile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.certfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.collect_timing = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.insecure = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.keyfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.number_of_retries = 60 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.retry_delay = 1 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.send_service_user_token = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.split_loggers = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.timeout = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.verify_ssl = True {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican.verify_ssl_path = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.auth_section = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.auth_type = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.cafile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.certfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.collect_timing = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.insecure = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.keyfile = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.split_loggers = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] barbican_service_user.timeout = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.approle_role_id = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.approle_secret_id = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.kv_mountpoint = secret {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.kv_path = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.kv_version = 2 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.namespace = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.root_token_id = **** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.ssl_ca_crt_file = None {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.timeout = 60.0 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.use_ssl = False {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:14 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] ******************************************************************************** {{(pid=82109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 22:13:14 devstack quobyte-client[82232]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 22:13:14 devstack quobyte-client[82232]: Invalid parameters found, error: missing mount point. Apr 16 22:13:14 devstack quobyte-client[82232]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 22:13:14 devstack quobyte-client[82232]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 22:13:14 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:14 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:13:14 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:13:14 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:13:14 devstack cinder-volume[82231]: INFO cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 ... Apr 16 22:13:14 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c -c /etc/quobyte/client-cinder.cfg {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:14 devstack sudo[82233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c -c /etc/quobyte/client-cinder.cfg Apr 16 22:13:14 devstack sudo[82233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:13:15 devstack sudo[82233]: pam_unix(sudo:session): session closed for user root Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.513s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:15 devstack cinder-volume[82231]: INFO cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 succeeded Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.520s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:15 devstack sudo[82302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:13:15 devstack sudo[82302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:13:15 devstack sudo[82302]: pam_unix(sudo:session): session closed for user root Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.432s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:15 devstack cinder-volume[82231]: INFO cinder.volume.driver [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Driver hasn't implemented _init_vendor_properties() Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG cinder.volume.driver [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327690124512, 'free_capacity_gb': 1775.7327690124512, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82231) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_db.sqlalchemy.engines [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82231) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG dbcounter [-] [82231] Writer thread running {{(pid=82231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG cinder.db.sqlalchemy.api [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Building query based on filter {{(pid=82231) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG cinder.image.image_utils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82231) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 22:13:15 devstack cinder-volume[82231]: INFO cinder.keymgr.migration [None req-7c4eba88-f6e5-4d73-8309-8c8eb86935c4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:13:15 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:15 devstack sudo[82305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:13:15 devstack sudo[82305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:13:16 devstack sudo[82305]: pam_unix(sudo:session): session closed for user root Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.460s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG cinder.manager [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Notifying Schedulers of capabilities ... {{(pid=82231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:13:16 devstack cinder-volume[82231]: INFO cinder.volume.manager [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Driver initialization completed successfully. Apr 16 22:13:16 devstack cinder-volume[82231]: INFO cinder.manager [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Initiating service 3 cleanup Apr 16 22:13:16 devstack cinder-volume[82231]: INFO cinder.manager [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Service 3 cleanup completed. Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG cinder.service [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Creating RPC server for service cinder-volume {{(pid=82231) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG cinder.service [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82231) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 22:13:16 devstack cinder-volume[82231]: INFO cinder.volume.manager [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:16 devstack sudo[82311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:13:16 devstack sudo[82311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:13:16 devstack sudo[82311]: pam_unix(sudo:session): session closed for user root Apr 16 22:13:16 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.518s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:16 devstack cinder-volume[82231]: INFO cinder.volume.manager [None req-6116d18b-7a8d-4eef-b7d6-6c13d8a29ffc None None] Driver post RPC initialization completed successfully. Apr 16 22:13:19 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-56801e18-94bd-4cde-bde7-e2212a98c86a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:13:19 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-56801e18-94bd-4cde-bde7-e2212a98c86a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:13:19 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-56801e18-94bd-4cde-bde7-e2212a98c86a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:13:19 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-56801e18-94bd-4cde-bde7-e2212a98c86a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:13:19 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-56801e18-94bd-4cde-bde7-e2212a98c86a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:13:19 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-56801e18-94bd-4cde-bde7-e2212a98c86a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:19 devstack sudo[82378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:13:19 devstack sudo[82378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:13:20 devstack sudo[82378]: pam_unix(sudo:session): session closed for user root Apr 16 22:13:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-56801e18-94bd-4cde-bde7-e2212a98c86a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.431s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:20 devstack cinder-volume[82231]: DEBUG cinder.manager [None req-56801e18-94bd-4cde-bde7-e2212a98c86a None None] Notifying Schedulers of capabilities ... {{(pid=82231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:13:21 devstack cinder-volume[82109]: INFO oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Caught SIGTERM, stopping children Apr 16 22:13:21 devstack cinder-volume[82109]: DEBUG oslo_concurrency.lockutils [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Acquiring lock "singleton_lock" {{(pid=82109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:13:21 devstack cinder-volume[82109]: DEBUG oslo_concurrency.lockutils [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Acquired lock "singleton_lock" {{(pid=82109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:13:21 devstack cinder-volume[82109]: DEBUG oslo_concurrency.lockutils [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Releasing lock "singleton_lock" {{(pid=82109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:13:21 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Stop services. {{(pid=82109) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 22:13:21 devstack cinder-volume[82109]: DEBUG oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Killing children. {{(pid=82109) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 22:13:21 devstack cinder-volume[82109]: INFO oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Waiting on 1 children to exit Apr 16 22:13:24 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Acquiring lock "singleton_lock" {{(pid=82231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:13:24 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Acquired lock "singleton_lock" {{(pid=82231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:13:24 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Releasing lock "singleton_lock" {{(pid=82231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:13:24 devstack cinder-volume[82231]: WARNING amqp [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 22:13:24 devstack cinder-volume[82231]: WARNING amqp [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 22:13:24 devstack cinder-volume[82109]: INFO oslo_service.backend._eventlet.service [None req-7c28a62b-910a-4800-ae2a-68c4308990fa None None] Child 82231 exited with status 0 Apr 16 22:13:24 devstack cinder-volume[82462]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 22:13:24 devstack cinder-volume[82462]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:13:24 devstack cinder-volume[82462]: we strongly recommend against using it for new projects. Apr 16 22:13:24 devstack cinder-volume[82462]: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:13:24 devstack cinder-volume[82462]: framework. For more detail see Apr 16 22:13:24 devstack cinder-volume[82462]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:13:24 devstack cinder-volume[82462]: import eventlet # noqa Apr 16 22:13:26 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:13:26 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:13:26 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:13:27 devstack cinder-volume[82462]: INFO dbcounter [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Registered counter for database cinder Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_db.sqlalchemy.engines [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG dbcounter [-] [82462] Writer thread running {{(pid=82462) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:13:27 devstack cinder-volume[82462]: INFO cinder.rpc [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 22:13:27 devstack cinder-volume[82462]: INFO cinder.rpc [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_db.sqlalchemy.engines [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:13:27 devstack cinder-volume[82462]: INFO cinder.volume.manager [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Determined volume DB was empty at startup. Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG cinder.volume.manager [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82462) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 16 22:13:27 devstack cinder-volume[82462]: WARNING stevedore.named [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 22:13:27 devstack cinder-volume[82462]: WARNING castellan.key_manager [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:13:27 devstack cinder-volume[82462]: WARNING cinder.keymgr.conf_key_mgr [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:13:27 devstack cinder-volume[82462]: INFO cinder.volume.manager [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_db.sqlalchemy.engines [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:13:27 devstack cinder-volume[82462]: INFO oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Starting 1 workers Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Started child 82650 {{(pid=82462) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Full set of CONF: {{(pid=82462) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] ******************************************************************************** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Configuration options gathered from: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 22:13:27 devstack cinder-volume[82650]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] ================================================================================ {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] allow_availability_zone_fallback = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] allow_compression_on_image_upload = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] allowed_direct_url_schemes = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] api_rate_limit = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] auth_strategy = keystone {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_availability_zone = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_host = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_stats_polling_interval = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backup_api_class = cinder.backup.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backup_name_template = backup-%s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backup_use_same_host = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backup_use_temp_snapshot = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] chap_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] chap_username = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_internal_tenant_project_id = c403c181b5374aca8906d9019d9d9f69 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_internal_tenant_user_id = a61d4b9709bf42db97a1da2c5f4b844f {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cluster = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] compression_format = gzip {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] compute_api_class = cinder.compute.nova.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] config_dir = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] config_source = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] control_exchange = openstack {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] debug = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] default_availability_zone = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] default_group_type = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] default_volume_type = QuobyteHD {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] disk_geometry = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] driver_client_cert = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] driver_client_cert_key = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] driver_data_namespace = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] driver_ssl_cert_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] driver_ssl_cert_verify = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] driver_use_ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] enable_new_services = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] enable_unsupported_driver = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] enabled_backends = ['QuobyteHD'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] enforce_multipath_for_image_xfer = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] filter_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_api_insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_api_ssl_compression = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_ca_certificates_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_catalog_info = image:glance:publicURL {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_num_retries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance_request_timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82650) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] goodness_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] graceful_shutdown_timeout = 5 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] group_api_class = cinder.group.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] host = devstack {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_compress_on_upload = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_conversion_address_space_limit = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_conversion_cpu_limit = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_conversion_disable = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_upload_use_cinder_backend = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_upload_use_internal_tenant = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_volume_cache_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_volume_cache_max_count = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] image_volume_cache_max_size_gb = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] init_host_max_objects_retrieval = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] instance_format = [instance: %(uuid)s] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] iscsi_target_flags = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] iscsi_write_cache = on {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] iser_helper = tgtadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] iser_ip_address = 192.168.122.24 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] iser_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_color = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_config_append = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_dir = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_options = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_rotate_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_rotate_interval_type = days {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] log_rotation_type = none {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] max_age = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] max_logfile_count = 30 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] max_logfile_size_mb = 200 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] max_over_subscription_ratio = 20.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] message_reap_interval = 86400 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] message_ttl = 2592000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] migration_create_volume_timeout_secs = 300 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] monkey_patch = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] monkey_patch_modules = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] my_ip = 192.168.122.24 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] no_snapshot_gb_quota = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] num_iser_scan_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] num_shell_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] num_volume_device_scan_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] nvmeof_conn_info_version = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] nvmet_ns_id = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] nvmet_port_id = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] osapi_max_limit = 1000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] osapi_volume_ext_list = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] osapi_volume_listen_port = 8776 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] osapi_volume_use_ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] osapi_volume_workers = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] per_volume_size_limit = -1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] periodic_fuzzy_delay = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] periodic_interval = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] public_endpoint = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] publish_errors = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] quota_backup_gigabytes = 1000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] quota_backups = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] quota_gigabytes = 1000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] quota_groups = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] quota_snapshots = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] quota_volumes = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] rate_limit_burst = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] rate_limit_except_level = CRITICAL {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] rate_limit_interval = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] reinit_driver_count = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] replication_device = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] report_discard_supported = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] report_interval = 120 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] reservation_clean_interval = 86400 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] reservation_expire = 86400 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] reserved_image_namespaces = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] reserved_percentage = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] rpc_response_timeout = 120 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] run_external_periodic_tasks = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] scst_target_driver = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] scst_target_iqn_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_down_time = 720 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] shell_completion = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] snapshot_name_template = snapshot-%s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] state_path = /opt/stack/data/cinder {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] storage_availability_zone = nova {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] storage_protocol = iSCSI {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] syslog_log_facility = LOG_USER {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] target_helper = lioadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] target_ip_address = 192.168.122.24 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] target_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] target_protocol = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] target_secondary_ip_addresses = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] trace_flags = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] transport_url = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] until_refresh = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] use_chap_auth = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] use_default_quota_class = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] use_journal = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] use_json = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] use_multipath_for_image_xfer = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] use_stderr = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] use_syslog = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] verify_glance_signatures = enabled {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_api_class = cinder.volume.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_backend_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_clear = zero {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_clear_ionice = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_clear_size = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_copy_bps_limit = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_dd_blocksize = 1M {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_name_template = volume-%s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_service_inithost_offload = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82650) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 22:13:27 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 22:13:27 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volume_usage_audit_period = month {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Running cmd (subprocess): mount.quobyte {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] zoning_mode = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_concurrency.disable_process_locking = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.admin_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.admin_token = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.admin_user = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.auth_port = 35357 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.auth_protocol = https {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.auth_section = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.auth_type = password {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.auth_uri = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.auth_version = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.cache = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.identity_uri = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.include_service_catalog = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.interface = public {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_password = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcache_username = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.region_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.service_type = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.backend = dogpile.cache.null {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.backend_argument = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.backend_expiration_time = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.config_prefix = cache.oslo {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.debug_cache_backend = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.enable_retry_client = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.enable_socket_keepalive = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.enforce_fips_mode = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.expiration_time = 600 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.hashclient_retry_attempts = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.memcache_dead_retry = 300 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.memcache_pool_maxsize = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.memcache_sasl_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.proxies = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.redis_db = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.redis_server = localhost:6379 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.retry_attempts = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.retry_delay = 0.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.socket_keepalive_count = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.socket_keepalive_idle = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.socket_keepalive_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.socket_timeout = 1.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.tls_allowed_ciphers = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.tls_cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.tls_certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.tls_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.tls_keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cache.username = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] coordination.backend_url = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.asyncio_connection = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.asyncio_slave_connection = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.backend = sqlalchemy {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.connection = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.connection_debug = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.connection_parameters = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.connection_recycle_time = 3600 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.connection_trace = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.db_inc_retry_interval = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.db_max_retries = 20 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.db_max_retry_interval = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.db_retry_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.max_overflow = 50 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.max_pool_size = 5 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.max_retries = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.mysql_wsrep_sync_wait = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.pool_timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.retry_interval = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.slave_connection = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.sqlite_synchronous = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.synchronous_reader = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] database.use_db_reconnect = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.connection_string = messaging:// {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.es_doc_type = notification {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.es_scroll_size = 10000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.es_scroll_time = 2m {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.filter_error_trace = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.hmac_keys = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.sentinel_service_name = mymaster {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.socket_timeout = 0.1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.trace_requests = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler.trace_sqlalchemy = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler_jaeger.process_tags = {} {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler_jaeger.service_name_prefix = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] profiler_otlp.service_name_prefix = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.enforce_new_defaults = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: WARNING oslo_config.cfg [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.enforce_scope = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.policy_default_rule = default {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.policy_file = policy.yaml {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] privsep_osbrick.group = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] privsep_osbrick.helper_command = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] privsep_osbrick.user = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_sys_admin.group = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_sys_admin.helper_command = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] cinder_sys_admin.user = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.auth_section = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.auth_type = password {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.collect_timing = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.send_service_user_token = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] service_user.timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.auth_section = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.auth_type = password {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack quobyte-client[82667]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 22:13:27 devstack quobyte-client[82667]: Invalid parameters found, error: missing mount point. Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.collect_timing = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack quobyte-client[82667]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 22:13:27 devstack quobyte-client[82667]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.region_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] glance.timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.backend_availability_zone = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.chap_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.chap_username = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.disk_geometry = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.driver_client_cert = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.driver_client_cert_key = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.driver_data_namespace = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.driver_use_ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.extra_capabilities = {} {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.filter_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.goodness_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.iscsi_target_flags = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.iscsi_write_cache = on {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.iser_helper = tgtadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.iser_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_host = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_login = admin {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_mount_options = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_private_key = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_share_path = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.num_shell_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.quobyte_volume_url = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.replication_device = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.report_discard_supported = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.reserved_percentage = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.target_helper = tgtadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.target_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.target_protocol = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.trace_flags = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.unique_fqdn_network = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.use_chap_auth = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volume_backend_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volume_clear = zero {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volume_clear_ionice = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volume_clear_size = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_reports.file_event_handler = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_reports.log_dir = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.backend_availability_zone = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.backend_host = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.chap_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack sudo[82672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.chap_username = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack sudo[82672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.chiscsi_conf = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.disk_geometry = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.driver_client_cert = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.driver_data_namespace = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.driver_use_ssl = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.extra_capabilities = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.filter_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.goodness_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.iser_helper = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.iser_ip_address = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.iser_port = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.iser_target_prefix = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_host = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_login = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_mount_options = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:27 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_private_key = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_share_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_ssh_port = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.num_shell_tries = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.nvmet_port_id = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.replication_device = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.report_discard_supported = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.reserved_percentage = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.scst_target_driver = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.storage_protocol = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.target_helper = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.target_ip_address = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.target_port = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.target_prefix = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.target_protocol = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.trace_flags = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.use_chap_auth = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volume_clear = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volume_clear_size = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] QuobyteHD.volumes_dir = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_notifications.driver = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_notifications.retry = -1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] key_manager.fixed_key = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.barbican_api_version = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.barbican_endpoint = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.barbican_endpoint_type = public {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.barbican_region_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.collect_timing = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.number_of_retries = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.retry_delay = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.send_service_user_token = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.verify_ssl = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican.verify_ssl_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.auth_section = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.auth_type = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.collect_timing = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] barbican_service_user.timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.approle_role_id = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.approle_secret_id = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.kv_mountpoint = secret {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.kv_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.kv_version = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.namespace = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.root_token_id = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.ssl_ca_crt_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.timeout = 60.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.use_ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:13:28 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-03043eca-a207-492e-8b6f-17cc4d2d58c7 None None] ******************************************************************************** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 22:13:28 devstack sudo[82672]: pam_unix(sudo:session): session closed for user root Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.411s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:28 devstack cinder-volume[82650]: INFO cinder.volume.driver [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.volume.driver [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327690124512, 'free_capacity_gb': 1775.7327690124512, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82650) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_db.sqlalchemy.engines [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writer thread running {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.db.sqlalchemy.api [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Building query based on filter {{(pid=82650) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82650) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:28 devstack cinder-volume[82650]: INFO cinder.keymgr.migration [None req-4e3bf0fb-1143-4dce-bb7b-af53d08ed0e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 22:13:28 devstack sudo[82692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:13:28 devstack sudo[82692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:13:28 devstack sudo[82692]: pam_unix(sudo:session): session closed for user root Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.398s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:13:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Driver initialization completed successfully. Apr 16 22:13:28 devstack cinder-volume[82650]: INFO cinder.manager [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Initiating service 3 cleanup Apr 16 22:13:28 devstack cinder-volume[82650]: INFO cinder.manager [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Service 3 cleanup completed. Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.service [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Creating RPC server for service cinder-volume {{(pid=82650) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.service [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82650) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 22:13:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:13:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:13:28 devstack sudo[82703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:13:28 devstack sudo[82703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:13:29 devstack sudo[82703]: pam_unix(sudo:session): session closed for user root Apr 16 22:13:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.402s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:13:29 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8546e0f1-9935-4225-85ce-f919e07a50d8 None None] Driver post RPC initialization completed successfully. Apr 16 22:13:37 devstack cinder-volume[82462]: DEBUG dbcounter [-] [82462] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82462) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:13:38 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=2 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:13:39 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:14:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:14:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 6 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:14:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:14:26 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ef943abb-e5cf-4691-a709-8593de1211b0 tempest-GroupsTest-1939326001 None] Group tempest-Group1-270029773: creating Apr 16 22:14:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ef943abb-e5cf-4691-a709-8593de1211b0 tempest-GroupsTest-1939326001 None] Group tempest-Group1-270029773: created successfully Apr 16 22:14:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ef943abb-e5cf-4691-a709-8593de1211b0 tempest-GroupsTest-1939326001 None] Create group completed successfully. Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Flow 'volume_create_manager' (93d9d037-2541-4b0f-8422-755f9dbc2e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b1e394-2d80-4f50-b1fb-bd6cabfd1ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b1e394-2d80-4f50-b1fb-bd6cabfd1ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-140954301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce5059a-bfe9-4b67-9692-0afca716e4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a632701563dd46899c57ec85dbeac6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:27Z,use_quota=True,user_id='9f1ec471f76748e7b60f0a3f9b355694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608bd36e-6a59-43db-99fe-0d538dd0df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608bd36e-6a59-43db-99fe-0d538dd0df0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b614b537-0bab-45f6-b780-8027c578e8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b614b537-0bab-45f6-b780-8027c578e8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce5059a-bfe9-4b67-9692-0afca716e4c3', 'volume_name': 'volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88445e53-8451-4b23-9b23-9abb9a3de484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88445e53-8451-4b23-9b23-9abb9a3de484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b98dd5-2231-498c-a28d-344590c3af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:27 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Volume 0ce5059a-bfe9-4b67-9692-0afca716e4c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3', 'volume_size': 1} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-140954301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce5059a-bfe9-4b67-9692-0afca716e4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a632701563dd46899c57ec85dbeac6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:27Z,use_quota=True,user_id='9f1ec471f76748e7b60f0a3f9b355694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Creating volume 0ce5059a-bfe9-4b67-9692-0afca716e4c3 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:14:27 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:27 devstack sudo[83174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 1073741824 Apr 16 22:14:27 devstack sudo[83174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Flow 'volume_create_manager' (21b81387-354b-454b-8f66-52513921a2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc2ced0-7cf2-4240-9181-db3654390a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc2ced0-7cf2-4240-9181-db3654390a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:14:25Z,deleted=False,deleted_at=None,display_description='',display_name='8d031d9b-4b26-4112-9275-08c75897b08c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949f3543-b456-4fab-8701-0150b1bdcf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ea446d999c467391f83a0e38f318ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:27Z,use_quota=True,user_id='1edb93fd0a1c40cabc217b3e6d8bb9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c60c6f5-3cb9-4e5f-a1a8-8f85009ab92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c60c6f5-3cb9-4e5f-a1a8-8f85009ab92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:28 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bf9d01-a9b4-4c92-b1f7-746bd6acdd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:28 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bf9d01-a9b4-4c92-b1f7-746bd6acdd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949f3543-b456-4fab-8701-0150b1bdcf39', 'volume_name': 'volume-949f3543-b456-4fab-8701-0150b1bdcf39', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:28 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07c225d-7326-430c-a0c8-21d809fa222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:28 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07c225d-7326-430c-a0c8-21d809fa222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:28 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd41d696-bf8f-4c50-9d92-8bf616649db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:28 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Volume 949f3543-b456-4fab-8701-0150b1bdcf39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949f3543-b456-4fab-8701-0150b1bdcf39', 'volume_size': 1} Apr 16 22:14:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6cfca52d-dccd-4769-a23c-22747485cd72 tempest-GroupsTest-1939326001 None] Group tempest-Group2-774361058: creating Apr 16 22:14:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6cfca52d-dccd-4769-a23c-22747485cd72 tempest-GroupsTest-1939326001 None] Group tempest-Group2-774361058: created successfully Apr 16 22:14:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6cfca52d-dccd-4769-a23c-22747485cd72 tempest-GroupsTest-1939326001 None] Create group completed successfully. Apr 16 22:14:29 devstack sudo[83174]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 1073741824" returned: 0 in 1.408s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:29 devstack sudo[83494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 Apr 16 22:14:29 devstack sudo[83494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Flow 'volume_create_manager' (87926403-9332-4d0a-814b-bf241ae1f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f354f4a4-f281-4722-ad77-3671af0cef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f354f4a4-f281-4722-ad77-3671af0cef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1180833482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca1ac5bc-ba03-407f-9161-ea7572532ac9,host='devstack@QuobyteHD#QuobyteHD',id=72c6f7e3-a913-49c4-934a-ec04a2ad826d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0116020407864c90af84dfdc154ffd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:30Z,use_quota=True,user_id='e0df3479467c4e83ae8c03a75f0f0cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(735c3bf0-ce3a-41c5-b776-835604df02e7),volume_type_id=735c3bf0-ce3a-41c5-b776-835604df02e7)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ed764c-11ff-489b-9042-2c823133f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ed764c-11ff-489b-9042-2c823133f328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed2b282-3205-48f2-b436-3625628f0dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed2b282-3205-48f2-b436-3625628f0dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c6f7e3-a913-49c4-934a-ec04a2ad826d', 'volume_name': 'volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642a4166-8264-4377-831c-fc8ea8541e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642a4166-8264-4377-831c-fc8ea8541e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdefc94-e235-4d36-ac10-91dc1221d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:30 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Volume 72c6f7e3-a913-49c4-934a-ec04a2ad826d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d', 'volume_size': 1} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:30 devstack sudo[83494]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3" returned: 0 in 1.135s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] <== create_volume: return (2627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.633s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.329s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:14:25Z,deleted=False,deleted_at=None,display_description='',display_name='8d031d9b-4b26-4112-9275-08c75897b08c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949f3543-b456-4fab-8701-0150b1bdcf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ea446d999c467391f83a0e38f318ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:27Z,use_quota=True,user_id='1edb93fd0a1c40cabc217b3e6d8bb9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Creating volume 949f3543-b456-4fab-8701-0150b1bdcf39 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:14:30 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b98dd5-2231-498c-a28d-344590c3af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cff311-5908-4eda-bf5e-d8e3a4c5a155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:30 devstack sudo[83514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 1073741824 Apr 16 22:14:30 devstack sudo[83514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:30 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Volume volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 (0ce5059a-bfe9-4b67-9692-0afca716e4c3): created successfully Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cff311-5908-4eda-bf5e-d8e3a4c5a155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Flow 'volume_create_manager' (93d9d037-2541-4b0f-8422-755f9dbc2e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:30 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e49b6c7c-4ce3-4837-8e93-ecc9ce3f5184 tempest-DeleteServersTestJSON-1699690149 None] Created volume successfully. Apr 16 22:14:31 devstack sudo[83514]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 1073741824" returned: 0 in 1.176s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:31 devstack sudo[83529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 Apr 16 22:14:31 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:32 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39" returned: 0 in 0.563s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.894s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca1ac5bc-ba03-407f-9161-ea7572532ac9,created_at=2026-04-16T20:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1180833482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca1ac5bc-ba03-407f-9161-ea7572532ac9,host='devstack@QuobyteHD#QuobyteHD',id=72c6f7e3-a913-49c4-934a-ec04a2ad826d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0116020407864c90af84dfdc154ffd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:30Z,use_quota=True,user_id='e0df3479467c4e83ae8c03a75f0f0cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(735c3bf0-ce3a-41c5-b776-835604df02e7),volume_type_id=735c3bf0-ce3a-41c5-b776-835604df02e7)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Creating volume 72c6f7e3-a913-49c4-934a-ec04a2ad826d {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:14:32 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd41d696-bf8f-4c50-9d92-8bf616649db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949f3543-b456-4fab-8701-0150b1bdcf39', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce026a14-1539-4a04-a959-25dd47ebdc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:32 devstack sudo[83532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d 1073741824 Apr 16 22:14:32 devstack sudo[83532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Volume volume-949f3543-b456-4fab-8701-0150b1bdcf39 (949f3543-b456-4fab-8701-0150b1bdcf39): created successfully Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce026a14-1539-4a04-a959-25dd47ebdc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Flow 'volume_create_manager' (21b81387-354b-454b-8f66-52513921a2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:32 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-2daa201e-8227-410d-9a43-5f0d0c66d707 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Created volume successfully. Apr 16 22:14:33 devstack sudo[83532]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d 1073741824" returned: 0 in 1.074s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:33 devstack sudo[83537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d Apr 16 22:14:33 devstack sudo[83537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:34 devstack sudo[83537]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d" returned: 0 in 0.803s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:14:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdefc94-e235-4d36-ac10-91dc1221d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a8842e-6e3e-48e6-bd81-ddc6e809a70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:34 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Volume volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d (72c6f7e3-a913-49c4-934a-ec04a2ad826d): created successfully Apr 16 22:14:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a8842e-6e3e-48e6-bd81-ddc6e809a70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Flow 'volume_create_manager' (87926403-9332-4d0a-814b-bf241ae1f775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:34 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f2bea306-031c-43f6-b585-6dd3646ab992 tempest-GroupsTest-1939326001 None] Created volume successfully. Apr 16 22:14:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Acquiring lock "cinder-quobyte-72c6f7e3-a913-49c4-934a-ec04a2ad826d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:14:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Lock "cinder-quobyte-72c6f7e3-a913-49c4-934a-ec04a2ad826d" acquired by "delete_volume" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:14:35 devstack cinder-volume[82650]: INFO oslo.privsep.daemon [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb49k2rn6/privsep.sock'] Apr 16 22:14:35 devstack sudo[83547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb49k2rn6/privsep.sock Apr 16 22:14:35 devstack sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 22:14:36 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING py.warnings [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 16 22:14:37 devstack cinder-volume[82650]: .first() Apr 16 22:14:37 devstack cinder-volume[82650]: Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-b18c7fff-2e58-41bf-9c45-7de7c430806a req-a8fc1dea-271a-42b0-9688-bf6c9c42cbed tempest-DeleteServersTestJSON-1699690149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:37 devstack sudo[83547]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:37 devstack cinder-volume[82650]: INFO oslo.privsep.daemon [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Spawned new privsep daemon via rootwrap Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Accepted privsep connection to /tmp/tmpb49k2rn6/privsep.sock {{(pid=82650) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 16 22:14:37 devstack cinder-volume[82650]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 16 22:14:37 devstack cinder-volume[82650]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 16 22:14:37 devstack cinder-volume[82650]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 16 22:14:37 devstack cinder-volume[82650]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83570 Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[054989c0-0cbf-4ca7-969b-ef6f28d73e5e]: (2,) {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:14:37 devstack cinder-volume[82650]: WARNING oslo_privsep.priv_context [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] privsep daemon already running Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[045bde4d-dde7-4203-bcac-41cc79c3b0fc]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[96085863-9ebb-4263-b730-8e6ce3bf3e93]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:37 devstack sudo[83575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 Apr 16 22:14:37 devstack sudo[83575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:38 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d Apr 16 22:14:38 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:39 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:39 devstack sudo[83575]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d" returned: 0 in 1.224s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39" returned: 0 in 1.245s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.518s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-b18c7fff-2e58-41bf-9c45-7de7c430806a req-a8fc1dea-271a-42b0-9688-bf6c9c42cbed tempest-DeleteServersTestJSON-1699690149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.459s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:39 devstack sudo[83591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d Apr 16 22:14:39 devstack sudo[83591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:39 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6958aa92-9d6b-4e7f-963a-b086c185985d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:14:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-b18c7fff-2e58-41bf-9c45-7de7c430806a req-a8fc1dea-271a-42b0-9688-bf6c9c42cbed tempest-DeleteServersTestJSON-1699690149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39', 'name': 'volume-949f3543-b456-4fab-8701-0150b1bdcf39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21045c9c-0096-498c-b221-a247853af239', 'enforce_multipath': True} {{(pid=82650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Apr 16 22:14:39 devstack sudo[83593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 Apr 16 22:14:39 devstack sudo[83593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:39 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-4a67c09d-6aa8-4525-860f-4f2802d603ce req-1eff0c25-65ce-40d9-a2f2-98d7a7889f86 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] attachment_update completed successfully. Apr 16 22:14:40 devstack sudo[83593]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-b18c7fff-2e58-41bf-9c45-7de7c430806a req-a8fc1dea-271a-42b0-9688-bf6c9c42cbed tempest-DeleteServersTestJSON-1699690149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3" returned: 0 in 0.983s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-b18c7fff-2e58-41bf-9c45-7de7c430806a req-a8fc1dea-271a-42b0-9688-bf6c9c42cbed tempest-DeleteServersTestJSON-1699690149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.012s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:40 devstack sudo[83591]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-72c6f7e3-a913-49c4-934a-ec04a2ad826d" returned: 0 in 1.091s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Lock "cinder-quobyte-72c6f7e3-a913-49c4-934a-ec04a2ad826d" released by "delete_volume" :: held 4.366s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-b18c7fff-2e58-41bf-9c45-7de7c430806a req-a8fc1dea-271a-42b0-9688-bf6c9c42cbed tempest-DeleteServersTestJSON-1699690149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39', 'name': 'volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f44548da-6a49-431f-9d61-5552f3c60aad', 'enforce_multipath': True} {{(pid=82650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Apr 16 22:14:40 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-b18c7fff-2e58-41bf-9c45-7de7c430806a req-a8fc1dea-271a-42b0-9688-bf6c9c42cbed tempest-DeleteServersTestJSON-1699690149 None] attachment_update completed successfully. Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Created reservations ['0bd28823-fcce-4c7e-ab4d-3cd53c31c802'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:14:40 devstack cinder-volume[82650]: WARNING cinder.quota [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-88652991 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-88652991, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:14:40 devstack cinder-volume[82650]: WARNING cinder.quota [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-88652991 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-88652991, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Created reservations ['b4091ed8-d16a-4bb5-8d22-353a6cd7c04a', '799985e7-d5e9-4654-be00-a9ecfe62a439', '1ab60687-8a5d-4956-9a53-8fa2bd8b9c35', '70e72628-a77b-48c4-ba93-502c5cc6431f'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:40 devstack sudo[83614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:14:40 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Created reservations ['15f3a131-4464-4a5c-b0f8-b4103ec9f8bc'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:41 devstack sudo[83639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:14:41 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:41 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.060s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:41 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:14:41 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ea4815ce-be83-4f20-85b2-297ac1dcb343 tempest-GroupsTest-1939326001 None] Delete group completed successfully. Apr 16 22:14:42 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.706s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:42 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:14:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1c4246ae-b964-41f9-a84b-2cf92b821323 tempest-GroupsTest-1939326001 None] Delete group completed successfully. Apr 16 22:14:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-63ce0f8f-a0e7-4a72-81a0-295d5416c796 tempest-GroupsTest-1939326001 None] Group tempest-GroupsTest-Group-130897322: creating Apr 16 22:14:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-63ce0f8f-a0e7-4a72-81a0-295d5416c796 tempest-GroupsTest-1939326001 None] Group tempest-GroupsTest-Group-130897322: created successfully Apr 16 22:14:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-63ce0f8f-a0e7-4a72-81a0-295d5416c796 tempest-GroupsTest-1939326001 None] Create group completed successfully. Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Flow 'volume_create_manager' (6a80d1ff-ce87-4512-a280-e1c9db30b0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1e9ac3-68c1-4bc5-b6bf-21f283a0003d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1e9ac3-68c1-4bc5-b6bf-21f283a0003d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496532362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ebad27d-1af7-4ce7-b151-68aebaeee58e,host='devstack@QuobyteHD#QuobyteHD',id=2c77bb0e-3b97-4be3-9684-c99ac825aefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0116020407864c90af84dfdc154ffd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:45Z,use_quota=True,user_id='e0df3479467c4e83ae8c03a75f0f0cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46de0070-3572-4f27-ba6b-e684b1c2c3cb),volume_type_id=46de0070-3572-4f27-ba6b-e684b1c2c3cb)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86dcd05f-6e91-481e-94d1-6edbb50b7568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86dcd05f-6e91-481e-94d1-6edbb50b7568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78bb75d-4979-42b2-b4ab-373cee87068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78bb75d-4979-42b2-b4ab-373cee87068a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c77bb0e-3b97-4be3-9684-c99ac825aefb', 'volume_name': 'volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965a6328-6658-48ad-8ab1-0e6d21b8629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965a6328-6658-48ad-8ab1-0e6d21b8629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d43eab-76e5-4d7f-a086-2dc0687410e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:44 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Volume 2c77bb0e-3b97-4be3-9684-c99ac825aefb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb', 'volume_size': 1} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4ebad27d-1af7-4ce7-b151-68aebaeee58e,created_at=2026-04-16T20:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496532362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ebad27d-1af7-4ce7-b151-68aebaeee58e,host='devstack@QuobyteHD#QuobyteHD',id=2c77bb0e-3b97-4be3-9684-c99ac825aefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0116020407864c90af84dfdc154ffd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:45Z,use_quota=True,user_id='e0df3479467c4e83ae8c03a75f0f0cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46de0070-3572-4f27-ba6b-e684b1c2c3cb),volume_type_id=46de0070-3572-4f27-ba6b-e684b1c2c3cb)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Creating volume 2c77bb0e-3b97-4be3-9684-c99ac825aefb {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:14:44 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:14:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:44 devstack sudo[84050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb 1073741824 Apr 16 22:14:44 devstack sudo[84050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:45 devstack sudo[84050]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb 1073741824" returned: 0 in 1.042s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:46 devstack sudo[84059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb Apr 16 22:14:46 devstack sudo[84059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:46 devstack sudo[84059]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb" returned: 0 in 0.691s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:14:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d43eab-76e5-4d7f-a086-2dc0687410e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db29ad71-a69d-4eb2-a5d1-20d2e901df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:46 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Volume volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb (2c77bb0e-3b97-4be3-9684-c99ac825aefb): created successfully Apr 16 22:14:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db29ad71-a69d-4eb2-a5d1-20d2e901df06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Flow 'volume_create_manager' (6a80d1ff-ce87-4512-a280-e1c9db30b0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:46 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d2ead81c-fce0-4bbc-abd6-eed7ded29376 tempest-GroupsTest-1939326001 None] Created volume successfully. Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Flow 'volume_create_manager' (45515587-8565-4cb5-a7d8-5c14522e5f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9750ba56-0c5f-44bb-b0c3-85bab02fa03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9750ba56-0c5f-44bb-b0c3-85bab02fa03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-945864972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ebad27d-1af7-4ce7-b151-68aebaeee58e,host='devstack@QuobyteHD#QuobyteHD',id=0a6c5b60-61f4-428c-bcdf-d16a50f6624e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0116020407864c90af84dfdc154ffd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:48Z,use_quota=True,user_id='e0df3479467c4e83ae8c03a75f0f0cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46de0070-3572-4f27-ba6b-e684b1c2c3cb),volume_type_id=46de0070-3572-4f27-ba6b-e684b1c2c3cb)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d10d87-beaa-4b61-8a69-5b04632d4321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d10d87-beaa-4b61-8a69-5b04632d4321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59971eb-2668-4b08-9e29-342d6256fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59971eb-2668-4b08-9e29-342d6256fd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6c5b60-61f4-428c-bcdf-d16a50f6624e', 'volume_name': 'volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f51430-00b7-4404-88a2-f44282490b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f51430-00b7-4404-88a2-f44282490b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409d6cee-99c1-4c3f-b991-1294c25d6324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:47 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Volume 0a6c5b60-61f4-428c-bcdf-d16a50f6624e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e', 'volume_size': 1} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4ebad27d-1af7-4ce7-b151-68aebaeee58e,created_at=2026-04-16T20:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-945864972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ebad27d-1af7-4ce7-b151-68aebaeee58e,host='devstack@QuobyteHD#QuobyteHD',id=0a6c5b60-61f4-428c-bcdf-d16a50f6624e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0116020407864c90af84dfdc154ffd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:14:48Z,use_quota=True,user_id='e0df3479467c4e83ae8c03a75f0f0cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46de0070-3572-4f27-ba6b-e684b1c2c3cb),volume_type_id=46de0070-3572-4f27-ba6b-e684b1c2c3cb)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Creating volume 0a6c5b60-61f4-428c-bcdf-d16a50f6624e {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:14:47 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:14:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:47 devstack sudo[84068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e 1073741824 Apr 16 22:14:47 devstack sudo[84068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:48 devstack sudo[84068]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e 1073741824" returned: 0 in 0.844s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:48 devstack sudo[84095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e Apr 16 22:14:48 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:49 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e" returned: 0 in 0.518s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:49 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:14:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409d6cee-99c1-4c3f-b991-1294c25d6324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7ff555-05c1-4942-9546-6c73cfde8ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:14:49 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Volume volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e (0a6c5b60-61f4-428c-bcdf-d16a50f6624e): created successfully Apr 16 22:14:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7ff555-05c1-4942-9546-6c73cfde8ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:14:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Flow 'volume_create_manager' (45515587-8565-4cb5-a7d8-5c14522e5f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:14:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-aca97598-5cef-4a33-a925-1700076c47f4 tempest-GroupsTest-1939326001 None] Created volume successfully. Apr 16 22:14:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-7ca38e2c-476b-4597-886b-6fda87641c0b tempest-GroupsTest-1939326001 None] Update group completed successfully. Apr 16 22:14:50 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-0f858774-6e57-4177-ac18-fe096a22ac44 req-1aac0d39-6a3e-43c4-a134-a722ecf47060 tempest-DeleteServersTestJSON-1699690149 None] Terminate volume connection completed successfully. Apr 16 22:14:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-0f858774-6e57-4177-ac18-fe096a22ac44 req-1aac0d39-6a3e-43c4-a134-a722ecf47060 tempest-DeleteServersTestJSON-1699690149 None] Deleting attachment f44548da-6a49-431f-9d61-5552f3c60aad. {{(pid=82650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Apr 16 22:14:51 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3afa20ab-bc26-4a90-8530-05781f4de6a1 tempest-GroupsTest-1939326001 None] Update group completed successfully. Apr 16 22:14:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Acquiring lock "cinder-quobyte-0a6c5b60-61f4-428c-bcdf-d16a50f6624e" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:14:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Lock "cinder-quobyte-0a6c5b60-61f4-428c-bcdf-d16a50f6624e" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:14:52 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d1f2c6-2872-45f5-8804-e8ce29c98f4f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:14:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:52 devstack sudo[84127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e Apr 16 22:14:52 devstack sudo[84127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:53 devstack sudo[84127]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e" returned: 0 in 0.569s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:53 devstack sudo[84134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e Apr 16 22:14:53 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:54 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0a6c5b60-61f4-428c-bcdf-d16a50f6624e" returned: 0 in 0.723s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Lock "cinder-quobyte-0a6c5b60-61f4-428c-bcdf-d16a50f6624e" released by "delete_volume" :: held 1.347s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Acquiring lock "cinder-quobyte-2c77bb0e-3b97-4be3-9684-c99ac825aefb" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Lock "cinder-quobyte-2c77bb0e-3b97-4be3-9684-c99ac825aefb" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dfd474-6580-41dc-9397-b989b7513a5d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:54 devstack sudo[84172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb Apr 16 22:14:54 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Acquiring lock "cinder-0ce5059a-bfe9-4b67-9692-0afca716e4c3-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Lock "cinder-0ce5059a-bfe9-4b67-9692-0afca716e4c3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Acquiring lock "cinder-quobyte-0ce5059a-bfe9-4b67-9692-0afca716e4c3" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Lock "cinder-quobyte-0ce5059a-bfe9-4b67-9692-0afca716e4c3" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41c68f2-cb1a-4d53-b446-d6e787d73403]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:54 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb" returned: 0 in 0.707s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:54 devstack sudo[84190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 Apr 16 22:14:54 devstack sudo[84190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:54 devstack sudo[84193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb Apr 16 22:14:54 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:55 devstack sudo[84190]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3" returned: 0 in 0.579s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:55 devstack sudo[84201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3 Apr 16 22:14:55 devstack sudo[84201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:55 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2c77bb0e-3b97-4be3-9684-c99ac825aefb" returned: 0 in 0.564s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Lock "cinder-quobyte-2c77bb0e-3b97-4be3-9684-c99ac825aefb" released by "delete_volume" :: held 1.298s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Created reservations ['3a849111-c9c2-47f3-b3f6-e25f115f172c'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:14:55 devstack cinder-volume[82650]: WARNING cinder.quota [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1645465705 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1645465705, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:14:55 devstack cinder-volume[82650]: WARNING cinder.quota [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1645465705 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1645465705, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Created reservations ['5219a70b-b091-4936-8328-871f25a9c097', '7bc2b234-df0c-4965-b057-b8aeb7691904', '240c8fce-8c71-4124-9c4f-ff46225b876f', 'd4f0a283-afc9-4f65-806b-717154f3c3b5'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Created reservations ['ca9b91b9-7163-488c-8d5c-bf1b123923f3', '96baad3b-b4ee-4436-83b7-cfc514a398d3', '624cafe9-c23d-4a76-89f0-73b3c8458b2c', 'bed62fd8-6c47-4a2f-aaa0-8c0b81d87ee1'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:55 devstack sudo[84204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:14:55 devstack sudo[84204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:55 devstack sudo[84201]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0ce5059a-bfe9-4b67-9692-0afca716e4c3" returned: 0 in 0.500s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Lock "cinder-quobyte-0ce5059a-bfe9-4b67-9692-0afca716e4c3" released by "delete_volume" :: held 1.115s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:14:55 devstack cinder-volume[82650]: WARNING cinder.quota [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:14:55 devstack cinder-volume[82650]: WARNING cinder.quota [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:14:55 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Created reservations ['7e22dde8-2bd1-4c24-8905-44b2b764f342', 'd2cb0d90-2b99-4b5a-9ac6-5cc7501f5aba', 'de3edcf0-2775-4d15-a00c-20bc2cf11d64', '4a9fa3c2-c176-4ea2-b6e6-f78a591b4d5d'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:14:56 devstack sudo[84208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:14:56 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:14:56 devstack sudo[84204]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.588s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:14:56 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b8068d49-12ac-4b3e-b560-bc58ecb3d589 tempest-GroupsTest-1939326001 None] Delete group completed successfully. Apr 16 22:14:56 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.598s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:14:56 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Deleted volume successfully. Apr 16 22:14:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0b5ffca0-31a9-45a5-97ea-184e4e18d4b9 tempest-DeleteServersTestJSON-1699690149 None] Lock "cinder-0ce5059a-bfe9-4b67-9692-0afca716e4c3-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:15:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9fa701bd-57c6-4653-a60a-8c00c5b7641a tempest-GroupsV314Test-1493356068 None] Group tempest-GroupsV314Test-Group-1886544208: creating Apr 16 22:15:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9fa701bd-57c6-4653-a60a-8c00c5b7641a tempest-GroupsV314Test-1493356068 None] Group tempest-GroupsV314Test-Group-1886544208: created successfully Apr 16 22:15:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9fa701bd-57c6-4653-a60a-8c00c5b7641a tempest-GroupsV314Test-1493356068 None] Create group completed successfully. Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Flow 'volume_create_manager' (8507b6fe-168d-49c7-be03-0a9aa1605621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0608b3-1c8f-410c-b143-f64e3938e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0608b3-1c8f-410c-b143-f64e3938e65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219459344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=787a2fe6-2608-4cff-95df-519050d7df04,host='devstack@QuobyteHD#QuobyteHD',id=cc916d33-7656-4055-8557-3a17920b3c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464d614dd8fa4cbd946ac3eab82a11bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:04Z,use_quota=True,user_id='3f444a081f2340f0bb51d6ac70b3befb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b606dc8-1d87-4e18-8b8c-83d143b1c197),volume_type_id=2b606dc8-1d87-4e18-8b8c-83d143b1c197)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82e47f7-9bad-464a-b047-966e9c4c9eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82e47f7-9bad-464a-b047-966e9c4c9eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d3f325-98c0-422e-abc8-aaf2b56d044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d3f325-98c0-422e-abc8-aaf2b56d044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc916d33-7656-4055-8557-3a17920b3c74', 'volume_name': 'volume-cc916d33-7656-4055-8557-3a17920b3c74', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865deeb5-303b-45ea-897b-60d2823b1ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865deeb5-303b-45ea-897b-60d2823b1ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1454b382-8316-45e5-a1d1-b01b352a2f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:04 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Volume cc916d33-7656-4055-8557-3a17920b3c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc916d33-7656-4055-8557-3a17920b3c74', 'volume_size': 1} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=787a2fe6-2608-4cff-95df-519050d7df04,created_at=2026-04-16T20:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219459344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=787a2fe6-2608-4cff-95df-519050d7df04,host='devstack@QuobyteHD#QuobyteHD',id=cc916d33-7656-4055-8557-3a17920b3c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464d614dd8fa4cbd946ac3eab82a11bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:04Z,use_quota=True,user_id='3f444a081f2340f0bb51d6ac70b3befb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b606dc8-1d87-4e18-8b8c-83d143b1c197),volume_type_id=2b606dc8-1d87-4e18-8b8c-83d143b1c197)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Creating volume cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:15:04 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:15:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:04 devstack sudo[84299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 1073741824 Apr 16 22:15:04 devstack sudo[84299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:05 devstack sudo[84299]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 1073741824" returned: 0 in 0.745s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:05 devstack sudo[84325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 Apr 16 22:15:05 devstack sudo[84325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:05 devstack sudo[84325]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74" returned: 0 in 0.643s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1454b382-8316-45e5-a1d1-b01b352a2f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc916d33-7656-4055-8557-3a17920b3c74', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f78883-ba58-423a-b776-27318a14ddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:05 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Volume volume-cc916d33-7656-4055-8557-3a17920b3c74 (cc916d33-7656-4055-8557-3a17920b3c74): created successfully Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f78883-ba58-423a-b776-27318a14ddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Flow 'volume_create_manager' (8507b6fe-168d-49c7-be03-0a9aa1605621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:15:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-544d131e-91d2-4429-9a91-27ff6089ef93 tempest-GroupsV314Test-1493356068 None] Created volume successfully. Apr 16 22:15:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:07 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Cloning volume cc916d33-7656-4055-8557-3a17920b3c74 to volume c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f Apr 16 22:15:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Creating offline snapshot f685e722-99fa-4a44-8b94-b53812f4357a of volume cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:15:07 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1204b7-a596-44f6-be51-3dcc99a33e7d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:07 devstack sudo[84348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 Apr 16 22:15:07 devstack sudo[84348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:08 devstack sudo[84348]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74" returned: 0 in 0.659s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:08 devstack sudo[84355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a 1G Apr 16 22:15:08 devstack sudo[84355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:09 devstack sudo[84355]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a 1G" returned: 0 in 0.753s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc916d33-7656-4055-8557-3a17920b3c74 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:09 devstack sudo[84363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc916d33-7656-4055-8557-3a17920b3c74 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a Apr 16 22:15:09 devstack sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:09 devstack sudo[84363]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc916d33-7656-4055-8557-3a17920b3c74 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a" returned: 0 in 0.584s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:09 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:15:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:09 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a Apr 16 22:15:09 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:10 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a" returned: 0 in 0.606s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:10 devstack sudo[84377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.info Apr 16 22:15:10 devstack sudo[84377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:11 devstack sudo[84377]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.info" returned: 0 in 0.632s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:11 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:11 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.info Apr 16 22:15:11 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:11 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.info" returned: 0 in 0.582s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Acquiring lock "cinder-quobyte-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Lock "cinder-quobyte-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] snapshot: f685e722-99fa-4a44-8b94-b53812f4357a, volume: c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63430f9-926a-422b-821b-fed27002b103]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:11 devstack sudo[84387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a Apr 16 22:15:11 devstack sudo[84387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:12 devstack sudo[84387]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a" returned: 0 in 0.596s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc916d33-7656-4055-8557-3a17920b3c74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d7e0de-10fe-4c2d-9a97-350c62b4b144]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:12 devstack sudo[84395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 Apr 16 22:15:12 devstack sudo[84395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:12 devstack sudo[84395]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74" returned: 0 in 0.540s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:15:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:12 devstack sudo[84400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f Apr 16 22:15:12 devstack sudo[84400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:16 devstack sudo[84400]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" returned: 0 in 3.317s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b19e573-dddf-499e-b1bc-58145b07b371]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:16 devstack sudo[84455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 Apr 16 22:15:16 devstack sudo[84455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:17 devstack sudo[84455]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74" returned: 0 in 1.253s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:17 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74, size 1024.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:15:17 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Converted 1024.00 MB image at 308.57 MB/s Apr 16 22:15:17 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:15:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:17 devstack sudo[84478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f Apr 16 22:15:17 devstack sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:18 devstack sudo[84478]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" returned: 0 in 0.777s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Lock "cinder-quobyte-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" released by "_copy_volume_from_snapshot" :: held 6.537s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:15:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Acquiring lock "cinder-quobyte-f685e722-99fa-4a44-8b94-b53812f4357a" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Lock "cinder-quobyte-f685e722-99fa-4a44-8b94-b53812f4357a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:18 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Deleting offline snapshot f685e722-99fa-4a44-8b94-b53812f4357a of volume cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:15:18 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] snapshot_file for this snap is: volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:15:18 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba443a1-ad28-4408-a9ff-dbfebde74d17]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:18 devstack sudo[84481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a Apr 16 22:15:18 devstack sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:19 devstack sudo[84481]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a" returned: 0 in 0.953s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc916d33-7656-4055-8557-3a17920b3c74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cbde1b-6e9e-4821-989a-2b653cc72b47]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=77,cinder:UPDATE=74,cinder:INSERT=13,cinder:DELETE=3 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=70,cinder:UPDATE=62,cinder:INSERT=14,cinder:DELETE=4 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:15:19 devstack sudo[84493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 Apr 16 22:15:19 devstack sudo[84493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Flow 'volume_create_manager' (fc87f65d-faeb-4361-a234-7a71ee40fcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5104547-70c9-4da1-b147-d955922e7129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5104547-70c9-4da1-b147-d955922e7129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1345277606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08810f78-6f48-480e-ad28-4e0ee60f3093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6395950de1624c75ae4201d3517c2026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:19Z,use_quota=True,user_id='99fc3519f5ac428bb6f25d9faa959be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c126e738-5da7-42dd-8fe6-1a7090dc1af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c126e738-5da7-42dd-8fe6-1a7090dc1af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e549a5-e75d-49a7-a2cf-985391a8edb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e549a5-e75d-49a7-a2cf-985391a8edb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08810f78-6f48-480e-ad28-4e0ee60f3093', 'volume_name': 'volume-08810f78-6f48-480e-ad28-4e0ee60f3093', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b20092-0fb5-4074-854f-087c4121635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b20092-0fb5-4074-854f-087c4121635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a0dec5-4648-423a-a555-b6dcc275661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:19 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Volume 08810f78-6f48-480e-ad28-4e0ee60f3093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08810f78-6f48-480e-ad28-4e0ee60f3093', 'volume_size': 1} Apr 16 22:15:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:20 devstack sudo[84493]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74" returned: 0 in 0.866s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:20 devstack sudo[84504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a Apr 16 22:15:20 devstack sudo[84504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:20 devstack sudo[84504]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a" returned: 0 in 0.669s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:20 devstack sudo[84511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a Apr 16 22:15:20 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:21 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74.f685e722-99fa-4a44-8b94-b53812f4357a" returned: 0 in 0.569s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Lock "cinder-quobyte-f685e722-99fa-4a44-8b94-b53812f4357a" released by "_delete_snapshot" :: held 3.158s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.756s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1345277606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08810f78-6f48-480e-ad28-4e0ee60f3093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6395950de1624c75ae4201d3517c2026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:19Z,use_quota=True,user_id='99fc3519f5ac428bb6f25d9faa959be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Creating volume 08810f78-6f48-480e-ad28-4e0ee60f3093 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:15:21 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:15:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:21 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 1073741824 Apr 16 22:15:21 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:21 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2fb51dd1-6fce-41cf-9d76-8e62f1c079b5 tempest-GroupsV314Test-1493356068 None] Create group from source-group-787a2fe6-2608-4cff-95df-519050d7df04 completed successfully. Apr 16 22:15:22 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 1073741824" returned: 0 in 0.575s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:22 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 Apr 16 22:15:22 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:22 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093" returned: 0 in 0.523s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a0dec5-4648-423a-a555-b6dcc275661d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08810f78-6f48-480e-ad28-4e0ee60f3093', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14722ed6-4744-4846-89ca-7d3bc3362a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:22 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Volume volume-08810f78-6f48-480e-ad28-4e0ee60f3093 (08810f78-6f48-480e-ad28-4e0ee60f3093): created successfully Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14722ed6-4744-4846-89ca-7d3bc3362a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Flow 'volume_create_manager' (fc87f65d-faeb-4361-a234-7a71ee40fcbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:15:22 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4206edb3-a68b-4a4e-8183-67842ec69bf7 tempest-VolumesAdminNegativeTest-1937278162 None] Created volume successfully. Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Acquiring lock "cinder-quobyte-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Lock "cinder-quobyte-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c47823-2937-44a8-a526-0662d3306264]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:22 devstack sudo[84528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f Apr 16 22:15:22 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:23 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" returned: 0 in 0.652s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:23 devstack sudo[84534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f Apr 16 22:15:23 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Acquiring lock "cinder-08810f78-6f48-480e-ad28-4e0ee60f3093-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Lock "cinder-08810f78-6f48-480e-ad28-4e0ee60f3093-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Acquiring lock "cinder-quobyte-08810f78-6f48-480e-ad28-4e0ee60f3093" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Lock "cinder-quobyte-08810f78-6f48-480e-ad28-4e0ee60f3093" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc572b31-c81c-4a6c-bc63-bb1de966877d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:24 devstack sudo[84562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 Apr 16 22:15:24 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:24 devstack sudo[84564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:15:24 devstack sudo[84564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:24 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" returned: 0 in 1.016s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Lock "cinder-quobyte-c9fd03ae-da5b-4dbd-93a4-0f7b4ec5424f" released by "delete_volume" :: held 1.702s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Created reservations ['93a776b5-3250-4447-afc4-b5fef752362b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:15:24 devstack cinder-volume[82650]: WARNING cinder.quota [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-190871464 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-190871464, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:15:24 devstack cinder-volume[82650]: WARNING cinder.quota [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-190871464 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-190871464, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Created reservations ['72bcca42-eac9-441a-be2f-0280f97d8e96', 'd18cff40-e98d-4172-9460-ca8e92aa89d9', 'c0fa3563-c822-4fdb-9a98-4fbea4c4ddf4', 'af8e0ac6-f2f1-4b73-a0c7-382e4ca7999a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:24 devstack sudo[84568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:15:24 devstack sudo[84568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:25 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093" returned: 0 in 1.696s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:25 devstack sudo[84576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093 Apr 16 22:15:25 devstack sudo[84576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Acquiring lock "cinder-quobyte-cc916d33-7656-4055-8557-3a17920b3c74" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Lock "cinder-quobyte-cc916d33-7656-4055-8557-3a17920b3c74" acquired by "delete_volume" :: waited 0.058s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:26 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[363cfbe7-5138-437a-9699-12e4d8414a2c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:26 devstack sudo[84582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 Apr 16 22:15:26 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:26 devstack sudo[84568]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.766s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:26 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:15:26 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d810e4fd-fc4e-4cd2-a153-cbe091cf3d0f tempest-GroupsV314Test-1493356068 None] Delete group completed successfully. Apr 16 22:15:27 devstack sudo[84564]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 2.816s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:27 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:15:27 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:15:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 8 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:15:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:15:27 devstack sudo[84576]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-08810f78-6f48-480e-ad28-4e0ee60f3093" returned: 0 in 2.065s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Lock "cinder-quobyte-08810f78-6f48-480e-ad28-4e0ee60f3093" released by "delete_volume" :: held 3.812s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Created reservations ['4485dbc4-6b08-4732-9b79-db6a7b95002a', 'f221260b-b028-4f73-8877-7ddea9840f3e', '5ccc7e3f-bab3-4fb5-83b7-13763de7074a', 'e91c7282-0edd-4e14-88eb-6411b3e7b0c5'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:15:28 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74" returned: 0 in 2.055s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:28 devstack sudo[84603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:15:28 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:28 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74 Apr 16 22:15:28 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:29 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.778s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:29 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:15:29 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Deleted volume successfully. Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b23a42aa-4098-479c-a274-5709debdb48e tempest-VolumesAdminNegativeTest-1937278162 None] Lock "cinder-08810f78-6f48-480e-ad28-4e0ee60f3093-delete_volume" released by "delete_volume" :: held 6.026s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:15:30 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc916d33-7656-4055-8557-3a17920b3c74" returned: 0 in 1.847s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Lock "cinder-quobyte-cc916d33-7656-4055-8557-3a17920b3c74" released by "delete_volume" :: held 4.041s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Created reservations ['7d8de841-da6c-4de1-b8d3-c7bcf8cd868c'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Created reservations ['0b74c7d9-1694-44c3-8e87-883f6272ab38', 'f7cbf8ba-2ddf-4801-b6ab-e1154b7937f7', 'f4528556-489d-4478-a39c-53f95089275b', 'cbc0080f-9ea6-436c-86a7-d1eed9f0c8c0'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:30 devstack sudo[84633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:15:30 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:31 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.771s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:31 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:15:31 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-67a3cea3-4d52-45a8-9cc8-382072fc0d1f tempest-GroupsV314Test-1493356068 None] Delete group completed successfully. Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Flow 'volume_create_manager' (07b793b6-9355-4031-bf9e-f2bc7554fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e18679-957f-4c80-9090-1bff5ac22fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e18679-957f-4c80-9090-1bff5ac22fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1036138462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556a6298-b845-4c3a-80c6-7a75c521bea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0da27b825f3453393ba54112c8636a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:38Z,use_quota=True,user_id='ca57ebc219a44efd83726277e0e0ddcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd1616d-8862-441a-93e2-7aa70e785fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd1616d-8862-441a-93e2-7aa70e785fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5b3ba7-f55d-42aa-92e8-806b8b276bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5b3ba7-f55d-42aa-92e8-806b8b276bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556a6298-b845-4c3a-80c6-7a75c521bea9', 'volume_name': 'volume-556a6298-b845-4c3a-80c6-7a75c521bea9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5674c50-2535-41fb-bf34-dcaa6b0ed1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5674c50-2535-41fb-bf34-dcaa6b0ed1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf48a76-9ad2-48e6-898f-95b6f2d0a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:38 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Volume 556a6298-b845-4c3a-80c6-7a75c521bea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556a6298-b845-4c3a-80c6-7a75c521bea9', 'volume_size': 1} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1036138462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556a6298-b845-4c3a-80c6-7a75c521bea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0da27b825f3453393ba54112c8636a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:38Z,use_quota=True,user_id='ca57ebc219a44efd83726277e0e0ddcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Creating volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:15:38 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:15:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:38 devstack sudo[84779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 1073741824 Apr 16 22:15:38 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:40 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 1073741824" returned: 0 in 1.612s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:40 devstack sudo[84787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 Apr 16 22:15:40 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:41 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9" returned: 0 in 1.146s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] <== create_volume: return (2838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:15:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.866s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf48a76-9ad2-48e6-898f-95b6f2d0a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556a6298-b845-4c3a-80c6-7a75c521bea9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79495bf5-3428-4bac-9436-c3484f56f889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:41 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Volume volume-556a6298-b845-4c3a-80c6-7a75c521bea9 (556a6298-b845-4c3a-80c6-7a75c521bea9): created successfully Apr 16 22:15:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79495bf5-3428-4bac-9436-c3484f56f889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Flow 'volume_create_manager' (07b793b6-9355-4031-bf9e-f2bc7554fec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:15:41 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-72ec6e78-66d7-4593-9792-1345901ebcc0 tempest-SnapshotsActionsTest-1550894562 None] Created volume successfully. Apr 16 22:15:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Creating offline snapshot 713d81de-f091-4c15-8ed6-0687cfce023c of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:15:43 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf8a925-6cfe-4aae-b774-9e653510af2d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:43 devstack sudo[84797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 Apr 16 22:15:43 devstack sudo[84797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:44 devstack sudo[84797]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9" returned: 0 in 1.490s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:44 devstack sudo[84817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c 1G Apr 16 22:15:44 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:45 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c 1G" returned: 0 in 0.839s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:45 devstack sudo[84838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:15:45 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:46 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 1.074s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:46 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c is being set with open permissions: ugo+rw Apr 16 22:15:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:46 devstack sudo[84853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:15:46 devstack sudo[84853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:47 devstack sudo[84853]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 0.597s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:47 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.info Apr 16 22:15:47 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:48 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.info" returned: 0 in 0.843s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:48 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.info is being set with open permissions: ugo+rw Apr 16 22:15:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:48 devstack sudo[84861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.info Apr 16 22:15:48 devstack sudo[84861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:48 devstack sudo[84861]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.info" returned: 0 in 0.791s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.849s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-08e498fb-668a-481f-a401-dd974a6640d9 tempest-SnapshotsActionsTest-1550894562 None] Create snapshot completed successfully Apr 16 22:15:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Creating offline snapshot ef486165-8019-4d3f-8d28-80f570a6907c of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:15:50 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2250ee-9b37-4059-915b-1c821ab6762e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:51 devstack sudo[84896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:15:51 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:51 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Flow 'volume_create_manager' (ca1e4204-2358-4b26-959a-a0f218a9f1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d5f96a-ccf3-4ff7-a130-700fd1dbbdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d5f96a-ccf3-4ff7-a130-700fd1dbbdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a11816-449e-4595-90bc-e27f7c6d9684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ea446d999c467391f83a0e38f318ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:52Z,use_quota=True,user_id='1edb93fd0a1c40cabc217b3e6d8bb9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf20419-5b44-4442-be66-90febe9f628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf20419-5b44-4442-be66-90febe9f628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1bb9b6-ad5c-447e-ac29-b90dba1acb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.image.glance [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Creating Keystone auth plugin from conf {{(pid=82650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1bb9b6-ad5c-447e-ac29-b90dba1acb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2a11816-449e-4595-90bc-e27f7c6d9684', 'volume_name': 'volume-b2a11816-449e-4595-90bc-e27f7c6d9684', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb3f861-18b6-4b0f-9e55-bd84dc0a72c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb3f861-18b6-4b0f-9e55-bd84dc0a72c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4cf3e7-91c3-49e1-9b53-9d017a091de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:52 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Volume b2a11816-449e-4595-90bc-e27f7c6d9684: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2a11816-449e-4595-90bc-e27f7c6d9684', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Trying to clone b2a11816-449e-4595-90bc-e27f7c6d9684 from image fc1a3fa2-bedc-4143-856a-42ade81658d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]). {{(pid=82650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 22:15:52 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 1.961s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:15:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:52 devstack sudo[84903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c 1G Apr 16 22:15:52 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:53 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 22:15:53 devstack cinder-volume[82650]: INFO cinder.image.image_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Image download 20.69 MB at 20.69 MB/s Apr 16 22:15:53 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ed9108-74b8-47eb-bd8d-5096ede757fe]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:53 devstack sudo[84928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD Apr 16 22:15:53 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:55 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD" returned: 0 in 1.619s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:55 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Temporary image fc1a3fa2-bedc-4143-856a-42ade81658d5 is fetched for user 1edb93fd0a1c40cabc217b3e6d8bb9e7. {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 22:15:55 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c 1G" returned: 0 in 2.131s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:55 devstack sudo[84972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c Apr 16 22:15:55 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:55 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fe5cdb-8801-4103-8a8f-2158b2f1713e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:55 devstack sudo[84974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD Apr 16 22:15:55 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:56 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD" returned: 0 in 1.390s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:56 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c" returned: 0 in 1.741s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:56 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c is being set with open permissions: ugo+rw Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:56 devstack sudo[84984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c Apr 16 22:15:56 devstack sudo[84984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Flow 'volume_create_manager' (7c070294-bcd9-4b8a-9b26-b3fbe9ed1f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e35525-e92a-44ce-8d10-242a0efe5426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e35525-e92a-44ce-8d10-242a0efe5426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1792739530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89316ea6-ba82-4b2d-9df9-89240af5414b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ba9d1b0e07477bacb8cb75c31fc14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:57Z,use_quota=True,user_id='e632e89fe7dc4151a55dc4d7d96ceea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78774bc-a088-454d-a874-41401d9fb2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78774bc-a088-454d-a874-41401d9fb2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22780b84-ff4b-426a-bf65-5645df03c4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22780b84-ff4b-426a-bf65-5645df03c4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89316ea6-ba82-4b2d-9df9-89240af5414b', 'volume_name': 'volume-89316ea6-ba82-4b2d-9df9-89240af5414b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958fbcb7-9501-453a-a01d-db6b2e58cebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958fbcb7-9501-453a-a01d-db6b2e58cebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76abc7b6-4ab2-484f-a97e-10a15b0178d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:15:57 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Volume 89316ea6-ba82-4b2d-9df9-89240af5414b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89316ea6-ba82-4b2d-9df9-89240af5414b', 'volume_size': 1} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:57 devstack sudo[84984]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c" returned: 0 in 0.866s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.941s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.197s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a11816-449e-4595-90bc-e27f7c6d9684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ea446d999c467391f83a0e38f318ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:52Z,use_quota=True,user_id='1edb93fd0a1c40cabc217b3e6d8bb9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Creating volume b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:15:57 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:15:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:57 devstack sudo[84987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 1073741824 Apr 16 22:15:57 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:57 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-fed74c21-2c58-47a5-b66a-21bd10fb15bc tempest-SnapshotsActionsTest-1550894562 None] Create snapshot completed successfully Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-ef486165-8019-4d3f-8d28-80f570a6907c-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-ef486165-8019-4d3f-8d28-80f570a6907c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-quobyte-ef486165-8019-4d3f-8d28-80f570a6907c" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-ef486165-8019-4d3f-8d28-80f570a6907c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Deleting offline snapshot ef486165-8019-4d3f-8d28-80f570a6907c of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] snapshot_file for this snap is: volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[25697e0f-18ae-4def-beb8-19b751585637]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:58 devstack sudo[84994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c Apr 16 22:15:58 devstack sudo[84994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:59 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 1073741824" returned: 0 in 1.565s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:15:59 devstack sudo[84997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:15:59 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:15:59 devstack sudo[84994]: pam_unix(sudo:session): session closed for user root Apr 16 22:15:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c" returned: 0 in 1.061s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:15:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:15:59 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06ccd7f-6d95-4626-8142-870224ef8616]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:15:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:00 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:00 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:00 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 0 in 1.038s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] <== create_volume: return (2696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.438s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1792739530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89316ea6-ba82-4b2d-9df9-89240af5414b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ba9d1b0e07477bacb8cb75c31fc14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:15:57Z,use_quota=True,user_id='e632e89fe7dc4151a55dc4d7d96ceea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Creating volume 89316ea6-ba82-4b2d-9df9-89240af5414b {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:16:00 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Attempting download of fc1a3fa2-bedc-4143-856a-42ade81658d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}])) to volume b2a11816-449e-4595-90bc-e27f7c6d9684. {{(pid=82650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 16 22:16:00 devstack sudo[85005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b 1073741824 Apr 16 22:16:00 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf9f0c-63b3-4b53-85eb-b33093f85ce9]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ufjb__97 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:00 devstack sudo[85010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ufjb__97 Apr 16 22:16:00 devstack sudo[85010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:01 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 1.199s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:01 devstack sudo[85015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c Apr 16 22:16:01 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:02 devstack sudo[85010]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ufjb__97" returned: 0 in 1.393s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ufjb__97 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:02 devstack sudo[85032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ufjb__97 Apr 16 22:16:02 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:02 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b 1073741824" returned: 0 in 1.919s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:02 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b Apr 16 22:16:02 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:03 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c" returned: 0 in 2.045s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:03 devstack sudo[85039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c Apr 16 22:16:03 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:03 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b" returned: 0 in 0.884s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] <== create_volume: return (2935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.944s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76abc7b6-4ab2-484f-a97e-10a15b0178d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89316ea6-ba82-4b2d-9df9-89240af5414b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b07e48-9240-47dc-9dc0-83e96f83f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:03 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Volume volume-89316ea6-ba82-4b2d-9df9-89240af5414b (89316ea6-ba82-4b2d-9df9-89240af5414b): created successfully Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b07e48-9240-47dc-9dc0-83e96f83f851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Flow 'volume_create_manager' (7c070294-bcd9-4b8a-9b26-b3fbe9ed1f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:03 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3f2fab16-dee8-445b-8bd3-d7b6b77e9b78 tempest-ServerRescueNegativeTestJSON-505491697 None] Created volume successfully. Apr 16 22:16:03 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ufjb__97" returned: 1 in 1.551s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ufjb__97' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4faa89-57c8-412c-b416-0ab3849e34a9]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:03 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ef486165-8019-4d3f-8d28-80f570a6907c" returned: 0 in 0.605s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:03 devstack sudo[85045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD Apr 16 22:16:03 devstack sudo[85045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-ef486165-8019-4d3f-8d28-80f570a6907c" released by "_delete_snapshot" :: held 5.198s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" released by "delete_snapshot" :: held 5.230s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:03 devstack cinder-volume[82650]: WARNING cinder.quota [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:16:03 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Created reservations ['344f4f05-4527-4722-b67c-57e4a81bbbc0', '9da04c72-7b90-4391-a546-972d8ab2820e', 'c23ff09e-d367-4a18-b174-4e5c2441dfcb', '15e4236c-0f02-4438-a742-e70971dd8d62'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:04 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Delete snapshot completed successfully. Apr 16 22:16:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cdeb9baa-7f58-4d3c-af7e-d23fe8d2d8c9 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-ef486165-8019-4d3f-8d28-80f570a6907c-delete_snapshot" released by "delete_snapshot" :: held 5.562s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:04 devstack sudo[85045]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD" returned: 0 in 1.215s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:04 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] fc1a3fa2-bedc-4143-856a-42ade81658d5 was qcow2, converting to raw {{(pid=82650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 22:16:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:04 devstack sudo[85052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:16:04 devstack sudo[85052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Flow 'volume_create_manager' (267ddc87-7047-4898-a768-01ec881739d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb75df5-1dc1-4bb4-823f-3040b9320114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb75df5-1dc1-4bb4-823f-3040b9320114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1790317160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274a9bd7-f9dd-4bca-b680-9fbe583b4731,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8949151418304a83aa3a02ae14662d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:05Z,use_quota=True,user_id='1ae2896bb01b4510b63badf68a651818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570a7838-2393-432f-b002-319e24bda647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570a7838-2393-432f-b002-319e24bda647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6b9fee-53c9-4f6d-9cbf-990663d19e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6b9fee-53c9-4f6d-9cbf-990663d19e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274a9bd7-f9dd-4bca-b680-9fbe583b4731', 'volume_name': 'volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38c8638-7fce-492d-99cc-7a38e664aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38c8638-7fce-492d-99cc-7a38e664aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e31622b-7775-4af5-8d48-a65a3ce5bd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:05 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Volume 274a9bd7-f9dd-4bca-b680-9fbe583b4731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731', 'volume_size': 1} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1790317160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274a9bd7-f9dd-4bca-b680-9fbe583b4731,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8949151418304a83aa3a02ae14662d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:05Z,use_quota=True,user_id='1ae2896bb01b4510b63badf68a651818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Creating volume 274a9bd7-f9dd-4bca-b680-9fbe583b4731 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:16:05 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:05 devstack sudo[85057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 1073741824 Apr 16 22:16:05 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:07 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 1073741824" returned: 0 in 1.368s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:07 devstack sudo[85065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 Apr 16 22:16:07 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:07 devstack sudo[85052]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 0 in 2.950s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:07 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_g9491nspdevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:16:07 devstack cinder-volume[82650]: INFO cinder.image.image_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Converted 112.00 MB image at 37.94 MB/s Apr 16 22:16:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:07 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 1G Apr 16 22:16:07 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:08 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731" returned: 0 in 0.902s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.133s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e31622b-7775-4af5-8d48-a65a3ce5bd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ebb5fe-b114-4e45-974d-151eb566615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Creating offline snapshot b5cfadb2-9a4e-4783-a2cd-ccf5603233ef of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:16:08 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Volume volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 (274a9bd7-f9dd-4bca-b680-9fbe583b4731): created successfully Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ebb5fe-b114-4e45-974d-151eb566615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Flow 'volume_create_manager' (267ddc87-7047-4898-a768-01ec881739d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c81940a-859c-42f4-b1ac-28b44ba7ca9b]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-82db49d8-eee4-4521-8520-e47794743148 req-c3c690cb-922a-4187-b791-bc8a690397e8 tempest-VolumesGetTestJSON-1745671170 None] Created volume successfully. Apr 16 22:16:08 devstack sudo[85070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:08 devstack sudo[85070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:08 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 1G" returned: 0 in 1.216s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adff4ee-5803-4b9b-83c4-ed5743bc87e9]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:09 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:16:09 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Acquiring lock "cinder-274a9bd7-f9dd-4bca-b680-9fbe583b4731-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Lock "cinder-274a9bd7-f9dd-4bca-b680-9fbe583b4731-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Acquiring lock "cinder-quobyte-274a9bd7-f9dd-4bca-b680-9fbe583b4731" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Lock "cinder-quobyte-274a9bd7-f9dd-4bca-b680-9fbe583b4731" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:09 devstack sudo[85070]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 1.388s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:09 devstack sudo[85108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef 1G Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37b8457-230a-4965-984c-7f0f82029333]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:09 devstack sudo[85108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:10 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 Apr 16 22:16:10 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:10 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 0 in 1.683s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:10 devstack sudo[85124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:16:10 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:11 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731" returned: 0 in 1.218s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:11 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731 Apr 16 22:16:11 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:11 devstack sudo[85108]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef 1G" returned: 0 in 1.414s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:11 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef Apr 16 22:16:11 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:11 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 1 in 1.087s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Downloaded image fc1a3fa2-bedc-4143-856a-42ade81658d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}])) to volume b2a11816-449e-4595-90bc-e27f7c6d9684 successfully. {{(pid=82650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Temporary image fc1a3fa2-bedc-4143-856a-42ade81658d5 for user 1edb93fd0a1c40cabc217b3e6d8bb9e7 is deleted. {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Marking volume b2a11816-449e-4595-90bc-e27f7c6d9684 as bootable. {{(pid=82650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Copying metadata from image fc1a3fa2-bedc-4143-856a-42ade81658d5 to b2a11816-449e-4595-90bc-e27f7c6d9684. {{(pid=82650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Creating volume glance metadata for volume b2a11816-449e-4595-90bc-e27f7c6d9684 backed by image fc1a3fa2-bedc-4143-856a-42ade81658d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 22:16:11 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-274a9bd7-f9dd-4bca-b680-9fbe583b4731" returned: 0 in 0.830s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Lock "cinder-quobyte-274a9bd7-f9dd-4bca-b680-9fbe583b4731" released by "delete_volume" :: held 2.218s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG cinder.quota [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Created reservations ['c6871293-3abd-431c-ab1c-74bb300f516f', '5fdc9261-c084-4002-9df7-2e38ddee05ff', '8258c09a-cbe6-4bf5-8fa3-b0835d0428be', 'e31857e7-cb34-4ced-9680-759c67735599'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4cf3e7-91c3-49e1-9b53-9d017a091de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a11816-449e-4595-90bc-e27f7c6d9684', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7ad9eb-04d4-46c4-ad74-f9b8c8424368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:12 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Volume volume-b2a11816-449e-4595-90bc-e27f7c6d9684 (b2a11816-449e-4595-90bc-e27f7c6d9684): created successfully Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7ad9eb-04d4-46c4-ad74-f9b8c8424368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Flow 'volume_create_manager' (ca1e4204-2358-4b26-959a-a0f218a9f1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:12 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-16ca373c-ef52-476e-b2e6-dbd202cfa5e2 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Created volume successfully. Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:12 devstack sudo[85141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:16:12 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:12 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef" returned: 0 in 1.137s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:12 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef is being set with open permissions: ugo+rw Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:12 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef Apr 16 22:16:12 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:12 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.704s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:12 devstack cinder-volume[82650]: DEBUG cinder.manager [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:16:13 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Deleted volume successfully. Apr 16 22:16:13 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef" returned: 0 in 0.678s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-05840e43-873a-49d1-b04a-0aaaa5d51a7e req-7bc1656c-35b9-4f10-86b3-74e4a8c4c6ea tempest-VolumesGetTestJSON-1745671170 None] Lock "cinder-274a9bd7-f9dd-4bca-b680-9fbe583b4731-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.979s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:13 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-71732d48-80ae-4c33-8a63-b5d81e613548 tempest-SnapshotsActionsTest-1550894562 None] Create snapshot completed successfully Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-b5cfadb2-9a4e-4783-a2cd-ccf5603233ef-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-b5cfadb2-9a4e-4783-a2cd-ccf5603233ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-quobyte-b5cfadb2-9a4e-4783-a2cd-ccf5603233ef" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-b5cfadb2-9a4e-4783-a2cd-ccf5603233ef" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Deleting offline snapshot b5cfadb2-9a4e-4783-a2cd-ccf5603233ef of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] snapshot_file for this snap is: volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09573f7-4d87-4a63-9ebc-d993f9f907bc]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:13 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef Apr 16 22:16:13 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:14 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[48212623-b894-4170-a6b1-41fd2a23e79e]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:14 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:16:14 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:15 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef" returned: 0 in 1.591s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2491f243-7e27-4f64-adcb-a2e04b444bd3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:15 devstack sudo[85193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:15 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:16 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 0 in 1.740s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:16 devstack sudo[85198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:16:16 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:16 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 1.516s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:16 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef Apr 16 22:16:16 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:17 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 1 in 1.572s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:16:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.368s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39', 'name': 'volume-b2a11816-449e-4595-90bc-e27f7c6d9684', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '409c7afa-e2c5-4d58-9f8b-8985191d8baf', 'enforce_multipath': True} {{(pid=82650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Apr 16 22:16:18 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-e92a4a7f-c252-48d8-8223-cc0292f8aaa0 req-6a6021cb-c6fb-4ae5-a706-c3ca3645d683 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] attachment_update completed successfully. Apr 16 22:16:19 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef" returned: 0 in 2.313s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:19 devstack sudo[85214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef Apr 16 22:16:19 devstack sudo[85214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:19 devstack sudo[85214]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.b5cfadb2-9a4e-4783-a2cd-ccf5603233ef" returned: 0 in 0.450s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-b5cfadb2-9a4e-4783-a2cd-ccf5603233ef" released by "_delete_snapshot" :: held 6.065s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" released by "delete_snapshot" :: held 6.102s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=70,cinder:UPDATE=56,cinder:INSERT=26,cinder:DELETE=2 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:UPDATE=78,cinder:SELECT=64,cinder:DELETE=8,cinder:INSERT=15 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Created reservations ['71407952-ddee-43fd-b155-17ec19f5a09c', 'dcb150b2-9125-4b40-bd13-68b3c01339d8', 'e3675d5e-9eee-4fb2-87a6-b34528675c12', '7f292e6f-f5e5-49e8-97a8-be7c1ead57e6'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:19 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Delete snapshot completed successfully. Apr 16 22:16:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ae740a2d-8d98-4315-8d20-50616553d593 tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-b5cfadb2-9a4e-4783-a2cd-ccf5603233ef-delete_snapshot" released by "delete_snapshot" :: held 6.313s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Creating offline snapshot ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:16:20 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7b4a2-b590-4676-b6da-3e9e92ec17c3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:20 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:20 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:22 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 1.483s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:22 devstack sudo[85281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 1G Apr 16 22:16:22 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:23 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 1G" returned: 0 in 1.136s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:23 devstack sudo[85309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 Apr 16 22:16:23 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Acquiring lock "cinder-89316ea6-ba82-4b2d-9df9-89240af5414b-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "cinder-89316ea6-ba82-4b2d-9df9-89240af5414b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Acquiring lock "cinder-quobyte-89316ea6-ba82-4b2d-9df9-89240af5414b" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "cinder-quobyte-89316ea6-ba82-4b2d-9df9-89240af5414b" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4076077-3dbe-49c6-a5d9-2b5cb78fd2c1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:24 devstack sudo[85318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:16:24 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:24 devstack sudo[85316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b Apr 16 22:16:24 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:24 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82" returned: 0 in 1.256s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:24 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 is being set with open permissions: ugo+rw Apr 16 22:16:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:24 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 Apr 16 22:16:24 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:25 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b" returned: 0 in 1.536s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:25 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b Apr 16 22:16:25 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:26 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.670s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:16:26 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82" returned: 0 in 1.623s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.713s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:26 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-38ddf21f-2b47-4fb4-bf97-4e5f30c07fc0 tempest-SnapshotsActionsTest-1550894562 None] Create snapshot completed successfully Apr 16 22:16:26 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89316ea6-ba82-4b2d-9df9-89240af5414b" returned: 0 in 0.780s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "cinder-quobyte-89316ea6-ba82-4b2d-9df9-89240af5414b" released by "delete_volume" :: held 2.410s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Created reservations ['ae566035-2a37-4340-b8ef-89fbe30bb771', 'b2290504-5bde-449a-a634-c2b9a85bddde', '1ee52be9-57ac-40c2-b2c8-4960d20b9b9d', '30d4ea5d-0e07-4096-b97e-7e411dceb67d'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:26 devstack sudo[85335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:16:26 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-ded5b239-a190-4cd7-ad80-4bc5ef4b6a82-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-ded5b239-a190-4cd7-ad80-4bc5ef4b6a82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" acquired by "delete_snapshot" :: waited 0.081s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-quobyte-ded5b239-a190-4cd7-ad80-4bc5ef4b6a82" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-ded5b239-a190-4cd7-ad80-4bc5ef4b6a82" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Deleting offline snapshot ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] snapshot_file for this snap is: volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e44f9da-aea9-4239-ac74-b3720dc8a6f6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:28 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 Apr 16 22:16:28 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:28 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.609s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:28 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:16:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Deleted volume successfully. Apr 16 22:16:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3665719c-82dd-4b86-a203-b78fd778ce02 tempest-ServerRescueNegativeTestJSON-505491697 None] Lock "cinder-89316ea6-ba82-4b2d-9df9-89240af5414b-delete_volume" released by "delete_volume" :: held 4.375s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:29 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82" returned: 0 in 1.860s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:29 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9388354-ffe5-416e-9f10-53f018dcfe7b]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:30 devstack sudo[85381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:30 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:31 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 1.475s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:31 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 Apr 16 22:16:31 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:32 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82" returned: 0 in 1.266s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:32 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82 Apr 16 22:16:32 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:33 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ded5b239-a190-4cd7-ad80-4bc5ef4b6a82" returned: 0 in 0.885s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-ded5b239-a190-4cd7-ad80-4bc5ef4b6a82" released by "_delete_snapshot" :: held 5.727s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" released by "delete_snapshot" :: held 5.787s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:33 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Created reservations ['9c985673-3516-4d4c-8e3f-50106de18259', '95a8b66a-7b09-4d56-9b04-50a2bd0fdd43', 'dcf688e7-c4b8-4bdb-a2b7-8c80733a1418', 'aa1c91f5-186f-4a09-9cd3-8a8fa15478f4'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:33 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Delete snapshot completed successfully. Apr 16 22:16:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9db5b303-883e-4a4f-9c1f-f702eb2a2c1f tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-ded5b239-a190-4cd7-ad80-4bc5ef4b6a82-delete_snapshot" released by "delete_snapshot" :: held 5.975s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Creating offline snapshot ccad8c46-427b-4f2b-8a09-48795e127aef of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:16:34 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[451c9175-2a3e-4ab9-85e3-34900f2e7fc3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:34 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:34 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:35 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 1.029s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:35 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef 1G Apr 16 22:16:35 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Flow 'volume_create_manager' (5e4e6bd9-77fd-4ee5-89e6-9efd871253d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9ff743-5378-499a-9ea0-1410b40316ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9ff743-5378-499a-9ea0-1410b40316ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1903444789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d8a0bb-9abb-4171-82ce-5497fdb19637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e94fd2a42974215b54cff53d6daba14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:36Z,use_quota=True,user_id='d11b4984f5c6479bad5755f4dce74b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fd0bc5-6386-4295-9646-bf45f30a9d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fd0bc5-6386-4295-9646-bf45f30a9d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76a2e94-9220-41d9-9d10-435f17a6f3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76a2e94-9220-41d9-9d10-435f17a6f3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d8a0bb-9abb-4171-82ce-5497fdb19637', 'volume_name': 'volume-09d8a0bb-9abb-4171-82ce-5497fdb19637', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b781a5-c739-431b-b4be-6a27c4c241c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b781a5-c739-431b-b4be-6a27c4c241c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3601bf7a-e59d-43a4-a2ac-317af87a1d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Volume 09d8a0bb-9abb-4171-82ce-5497fdb19637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d8a0bb-9abb-4171-82ce-5497fdb19637', 'volume_size': 1} Apr 16 22:16:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:36 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef 1G" returned: 0 in 0.951s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:36 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef Apr 16 22:16:36 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:37 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef" returned: 0 in 0.800s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:37 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef is being set with open permissions: ugo+rw Apr 16 22:16:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:37 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef Apr 16 22:16:37 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:38 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef" returned: 0 in 0.601s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.545s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1903444789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d8a0bb-9abb-4171-82ce-5497fdb19637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e94fd2a42974215b54cff53d6daba14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:36Z,use_quota=True,user_id='d11b4984f5c6479bad5755f4dce74b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Creating volume 09d8a0bb-9abb-4171-82ce-5497fdb19637 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:16:38 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:38 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 1073741824 Apr 16 22:16:38 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-81324559-4d47-48e2-8142-b3aeb5942a5b tempest-SnapshotsActionsTest-1550894562 None] Create snapshot completed successfully Apr 16 22:16:38 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-ccad8c46-427b-4f2b-8a09-48795e127aef-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-ccad8c46-427b-4f2b-8a09-48795e127aef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Acquiring lock "cinder-quobyte-ccad8c46-427b-4f2b-8a09-48795e127aef" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-ccad8c46-427b-4f2b-8a09-48795e127aef" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Deleting offline snapshot ccad8c46-427b-4f2b-8a09-48795e127aef of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] snapshot_file for this snap is: volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2f6a21-1921-4ec3-9ce5-b097377e3463]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:39 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 1073741824" returned: 0 in 0.877s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:39 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 Apr 16 22:16:39 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:39 devstack sudo[85529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef Apr 16 22:16:39 devstack sudo[85529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:39 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637" returned: 0 in 0.544s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3601bf7a-e59d-43a4-a2ac-317af87a1d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d8a0bb-9abb-4171-82ce-5497fdb19637', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b99cb5-2023-495a-a4cb-167d0d482afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:39 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Volume volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 (09d8a0bb-9abb-4171-82ce-5497fdb19637): created successfully Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b99cb5-2023-495a-a4cb-167d0d482afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Flow 'volume_create_manager' (5e4e6bd9-77fd-4ee5-89e6-9efd871253d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:39 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-034472cd-c0cc-4698-9c1e-f3a8172845bf tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Created volume successfully. Apr 16 22:16:39 devstack sudo[85529]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef" returned: 0 in 0.686s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f955cea-e6af-4081-8459-974f8073a6a1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:39 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:39 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Creating offline snapshot 3797f44e-6827-4454-820d-64b25dbfce56 of volume 09d8a0bb-9abb-4171-82ce-5497fdb19637 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:16:40 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 0.650s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:40 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e9dabf-16f8-40a9-9759-3d297ae4deca]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:40 devstack sudo[85550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef Apr 16 22:16:40 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:40 devstack sudo[85551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 Apr 16 22:16:40 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:41 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:41 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637" returned: 0 in 0.608s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef" returned: 0 in 0.630s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:41 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 1G Apr 16 22:16:41 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:41 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef Apr 16 22:16:41 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:41 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.ccad8c46-427b-4f2b-8a09-48795e127aef" returned: 0 in 0.956s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-ccad8c46-427b-4f2b-8a09-48795e127aef" released by "_delete_snapshot" :: held 3.038s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" released by "delete_snapshot" :: held 3.055s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:42 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Created reservations ['d5afc3de-9229-4d4b-ab09-695071fe947b', '52ab815d-cb2b-43c2-8ee2-5e3b530878b1', 'e44d3c19-0d59-40ee-9944-8deb628c0cad', '1ac04449-78dd-4b61-a527-fbbdb5a82d00'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:42 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 1G" returned: 0 in 1.128s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:42 devstack sudo[85596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 Apr 16 22:16:42 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Delete snapshot completed successfully. Apr 16 22:16:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b1c8bc90-ce5b-47fd-ab14-d13bd659c99d tempest-SnapshotsActionsTest-700083600 None] Lock "cinder-ccad8c46-427b-4f2b-8a09-48795e127aef-delete_snapshot" released by "delete_snapshot" :: held 3.251s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:42 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56" returned: 0 in 0.588s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:42 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 is being set with open permissions: ugo+rw Apr 16 22:16:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:42 devstack sudo[85601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 Apr 16 22:16:42 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:43 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56" returned: 0 in 0.535s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:43 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.info Apr 16 22:16:43 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "cinder-713d81de-f091-4c15-8ed6-0687cfce023c-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-713d81de-f091-4c15-8ed6-0687cfce023c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "cinder-quobyte-713d81de-f091-4c15-8ed6-0687cfce023c" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-quobyte-713d81de-f091-4c15-8ed6-0687cfce023c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Deleting offline snapshot 713d81de-f091-4c15-8ed6-0687cfce023c of volume 556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] snapshot_file for this snap is: volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f7e5b8-cb87-476a-8270-39411cf4dc32]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:43 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:43 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:44 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.info" returned: 0 in 0.986s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:44 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.info is being set with open permissions: ugo+rw Apr 16 22:16:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:44 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.info Apr 16 22:16:44 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:44 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 0.775s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556a6298-b845-4c3a-80c6-7a75c521bea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5830e-49ec-4a28-8f6c-20de91a31776]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:44 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 Apr 16 22:16:44 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:45 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.info" returned: 0 in 0.722s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.695s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:45 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5b5f3546-03aa-4c5c-8ff3-f6253931306a tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Create snapshot completed successfully Apr 16 22:16:45 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9" returned: 0 in 0.959s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:45 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:45 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "cinder-3797f44e-6827-4454-820d-64b25dbfce56-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-3797f44e-6827-4454-820d-64b25dbfce56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "cinder-quobyte-09d8a0bb-9abb-4171-82ce-5497fdb19637" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-quobyte-09d8a0bb-9abb-4171-82ce-5497fdb19637" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "cinder-quobyte-3797f44e-6827-4454-820d-64b25dbfce56" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-quobyte-3797f44e-6827-4454-820d-64b25dbfce56" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Deleting offline snapshot 3797f44e-6827-4454-820d-64b25dbfce56 of volume 09d8a0bb-9abb-4171-82ce-5497fdb19637 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] snapshot_file for this snap is: volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c091c2-16ef-485d-828d-9573317ed8a6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:46 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 Apr 16 22:16:46 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:46 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 0.965s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:46 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c Apr 16 22:16:46 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:46 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56" returned: 0 in 0.899s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09d8a0bb-9abb-4171-82ce-5497fdb19637(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7361e8-483c-4733-bf3b-a8629280d357]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:47 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 Apr 16 22:16:47 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:47 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9.713d81de-f091-4c15-8ed6-0687cfce023c" returned: 0 in 0.775s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-quobyte-713d81de-f091-4c15-8ed6-0687cfce023c" released by "_delete_snapshot" :: held 3.609s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" released by "delete_snapshot" :: held 3.634s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:47 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Created reservations ['31f07033-bfbc-4858-ac5d-f0240ccb9e24', '95b4c2f2-7f3d-4fbc-a885-316e6ad2edf8', 'a5465dbd-1a66-4afd-b22c-b939657a8690', 'c2f555d3-66ed-4cf2-ada7-975010d460b1'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:47 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Delete snapshot completed successfully. Apr 16 22:16:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-69bdd702-c040-4075-9c3a-c0006cadd348 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-713d81de-f091-4c15-8ed6-0687cfce023c-delete_snapshot" released by "delete_snapshot" :: held 3.886s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:47 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637" returned: 0 in 0.881s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:47 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 Apr 16 22:16:47 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "cinder-556a6298-b845-4c3a-80c6-7a75c521bea9-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-556a6298-b845-4c3a-80c6-7a75c521bea9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:48 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0309e32-84cf-40f9-ae73-d162df0a2d2d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:48 devstack sudo[85691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 Apr 16 22:16:48 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:49 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56" returned: 0 in 1.295s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:49 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56 Apr 16 22:16:49 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:49 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9" returned: 0 in 1.222s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:49 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9 Apr 16 22:16:49 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:49 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637.3797f44e-6827-4454-820d-64b25dbfce56" returned: 0 in 0.757s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-quobyte-3797f44e-6827-4454-820d-64b25dbfce56" released by "_delete_snapshot" :: held 3.972s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-quobyte-09d8a0bb-9abb-4171-82ce-5497fdb19637" released by "delete_snapshot" :: held 3.986s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Created reservations ['8e9a2f65-ab5c-4dee-8123-3b7015334189', '0eed442b-3a29-474b-b62d-a89e0a5c4985', 'd740d892-44f1-415d-b771-830184010c3e', 'a6dca0eb-9832-48b1-9609-22f0b4e05ca0'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:50 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Delete snapshot completed successfully. Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7135aff3-86e2-4f84-8fdc-10aee21e1cfd tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-3797f44e-6827-4454-820d-64b25dbfce56-delete_snapshot" released by "delete_snapshot" :: held 4.289s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:50 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556a6298-b845-4c3a-80c6-7a75c521bea9" returned: 0 in 0.833s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-quobyte-556a6298-b845-4c3a-80c6-7a75c521bea9" released by "delete_volume" :: held 2.147s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Created reservations ['3396723a-db22-4ac7-b7da-c3996f6656cf', 'ff227e79-c7fd-4a13-8cab-971dd52fee80', 'e2860397-5fbd-4354-900c-61136341b0f7', '359d8a59-53b4-4a95-aed6-0d0f124561c7'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:50 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:16:50 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:51 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.623s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:16:51 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Deleted volume successfully. Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c4562d4d-911b-4131-876f-f5b3063291d5 tempest-SnapshotsActionsTest-1550894562 None] Lock "cinder-556a6298-b845-4c3a-80c6-7a75c521bea9-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "cinder-09d8a0bb-9abb-4171-82ce-5497fdb19637-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-09d8a0bb-9abb-4171-82ce-5497fdb19637-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "cinder-quobyte-09d8a0bb-9abb-4171-82ce-5497fdb19637" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-quobyte-09d8a0bb-9abb-4171-82ce-5497fdb19637" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c63e6d-9001-45ec-a1b9-a84c8967e16f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:51 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 Apr 16 22:16:51 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:52 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637" returned: 0 in 0.786s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:52 devstack sudo[85744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637 Apr 16 22:16:52 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Flow 'volume_create_manager' (8dff5da7-4d96-4753-86a2-1846e0980e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28ca944-1d10-48b2-b627-7ddd3263f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28ca944-1d10-48b2-b627-7ddd3263f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1836440082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8336f7c-bc78-48d1-af52-20d3868342e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fca632ea2aad47668b4cb61a2891369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:53Z,use_quota=True,user_id='6abca93dfe6e4944ba411db63e9b7235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d81ee1f-94da-47b3-97bf-184f175f6f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d81ee1f-94da-47b3-97bf-184f175f6f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571904e1-655b-489d-81fb-b76e1f676530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571904e1-655b-489d-81fb-b76e1f676530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8336f7c-bc78-48d1-af52-20d3868342e7', 'volume_name': 'volume-d8336f7c-bc78-48d1-af52-20d3868342e7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cc1843-c31b-4aaa-b9a9-f1fdb97532b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cc1843-c31b-4aaa-b9a9-f1fdb97532b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2885a3da-9f5e-4656-b40a-f63223fc34a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:52 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Volume d8336f7c-bc78-48d1-af52-20d3868342e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8336f7c-bc78-48d1-af52-20d3868342e7', 'volume_size': 1} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1836440082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8336f7c-bc78-48d1-af52-20d3868342e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fca632ea2aad47668b4cb61a2891369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:53Z,use_quota=True,user_id='6abca93dfe6e4944ba411db63e9b7235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Creating volume d8336f7c-bc78-48d1-af52-20d3868342e7 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:16:52 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:16:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:52 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 1073741824 Apr 16 22:16:52 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:53 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-09d8a0bb-9abb-4171-82ce-5497fdb19637" returned: 0 in 0.701s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-quobyte-09d8a0bb-9abb-4171-82ce-5497fdb19637" released by "delete_volume" :: held 1.537s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Created reservations ['41b50022-2c12-45ad-bf1a-352ae165aa88', 'f0d52a82-ac9a-4d85-9ae5-5d79da5d239c', 'eeb6ee86-9c35-45d3-96b8-321f181da484', 'd3ae2476-8bc3-4dfe-88f5-76176884d06f'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:53 devstack sudo[85751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:16:53 devstack sudo[85751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:53 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 1073741824" returned: 0 in 0.878s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:53 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 Apr 16 22:16:53 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:54 devstack sudo[85751]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.907s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:16:54 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Deleted volume successfully. Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08e63fc9-3bde-4a11-9aef-b6f14fd46308 tempest-VolumeSnapshotQuotasNegativeTestJSON-602644686 None] Lock "cinder-09d8a0bb-9abb-4171-82ce-5497fdb19637-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:54 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7" returned: 0 in 0.572s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:54 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-47b9351a-b0f5-4888-adc1-a6fb15a0d440 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Terminate volume connection completed successfully. Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-47b9351a-b0f5-4888-adc1-a6fb15a0d440 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Deleting attachment 409c7afa-e2c5-4d58-9f8b-8985191d8baf. {{(pid=82650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2885a3da-9f5e-4656-b40a-f63223fc34a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8336f7c-bc78-48d1-af52-20d3868342e7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce78a197-c527-41db-9137-ee91cbb31e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:54 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Volume volume-d8336f7c-bc78-48d1-af52-20d3868342e7 (d8336f7c-bc78-48d1-af52-20d3868342e7): created successfully Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce78a197-c527-41db-9137-ee91cbb31e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Flow 'volume_create_manager' (8dff5da7-4d96-4753-86a2-1846e0980e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:54 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-20da2f41-077a-4f32-87eb-a2cea2e367e5 tempest-VolumesTestJSON-1171268979 None] Created volume successfully. Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "cinder-b2a11816-449e-4595-90bc-e27f7c6d9684-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "cinder-b2a11816-449e-4595-90bc-e27f7c6d9684-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "cinder-quobyte-b2a11816-449e-4595-90bc-e27f7c6d9684" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "cinder-quobyte-b2a11816-449e-4595-90bc-e27f7c6d9684" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[294c24c1-8c7b-4902-ab64-94e87adac67a]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:55 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:16:55 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Flow 'volume_create_manager' (0ee5a10f-f4fa-4a3b-bed7-97051ea3db11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2b097d-321a-44fe-aa06-b13ac8f0b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2b097d-321a-44fe-aa06-b13ac8f0b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-325331226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18be1025-da2f-4f2c-ba61-c658d03542f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fca632ea2aad47668b4cb61a2891369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:55Z,use_quota=True,user_id='6abca93dfe6e4944ba411db63e9b7235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f79c85-6b2d-47ca-8529-c8b635b2c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f79c85-6b2d-47ca-8529-c8b635b2c640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8249acf4-60fa-4d8b-87f3-68befcff77f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8249acf4-60fa-4d8b-87f3-68befcff77f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18be1025-da2f-4f2c-ba61-c658d03542f6', 'volume_name': 'volume-18be1025-da2f-4f2c-ba61-c658d03542f6', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd07c9e-6054-4a56-bb35-94e6557dd61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd07c9e-6054-4a56-bb35-94e6557dd61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bded5216-caa2-4c00-9368-353a93e992bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:55 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Volume 18be1025-da2f-4f2c-ba61-c658d03542f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18be1025-da2f-4f2c-ba61-c658d03542f6', 'volume_size': 1} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-325331226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18be1025-da2f-4f2c-ba61-c658d03542f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fca632ea2aad47668b4cb61a2891369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:55Z,use_quota=True,user_id='6abca93dfe6e4944ba411db63e9b7235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Creating volume 18be1025-da2f-4f2c-ba61-c658d03542f6 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:16:55 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:16:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:55 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 1073741824 Apr 16 22:16:55 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:55 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 0 in 0.770s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:56 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:16:56 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:56 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 1073741824" returned: 0 in 0.786s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:56 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 Apr 16 22:16:56 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:56 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 1 in 0.730s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:56 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684 Apr 16 22:16:56 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:56 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6" returned: 0 in 0.663s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bded5216-caa2-4c00-9368-353a93e992bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18be1025-da2f-4f2c-ba61-c658d03542f6', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a376947a-e007-4930-a55c-83a104123052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:56 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Volume volume-18be1025-da2f-4f2c-ba61-c658d03542f6 (18be1025-da2f-4f2c-ba61-c658d03542f6): created successfully Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a376947a-e007-4930-a55c-83a104123052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Flow 'volume_create_manager' (0ee5a10f-f4fa-4a3b-bed7-97051ea3db11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:56 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e9594ddc-6f37-4b8b-b06f-1e08f60ec444 tempest-VolumesTestJSON-1171268979 None] Created volume successfully. Apr 16 22:16:57 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b2a11816-449e-4595-90bc-e27f7c6d9684" returned: 0 in 0.585s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "cinder-quobyte-b2a11816-449e-4595-90bc-e27f7c6d9684" released by "delete_volume" :: held 2.151s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG cinder.quota [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Created reservations ['bf2ff5d2-91ed-419c-b932-c3287ac6fb06', '41a20a8b-52ab-4398-ae38-1dbfd9bcbbae', 'bba2fc22-757a-4595-8192-49e8fae6b88f', '6c9692e0-f17a-47e7-8692-549bf0b9c5af'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:57 devstack sudo[85818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:16:57 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Flow 'volume_create_manager' (3b5fb140-31ba-4e33-a140-3f02a2a0c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3902fe42-ec91-46c5-9a50-8966595b367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3902fe42-ec91-46c5-9a50-8966595b367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1869508342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf11e69-1d50-465e-91e7-4f66065c91b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fca632ea2aad47668b4cb61a2891369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:58Z,use_quota=True,user_id='6abca93dfe6e4944ba411db63e9b7235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dd92bc-8d9e-459d-9aa6-1eb67c34276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dd92bc-8d9e-459d-9aa6-1eb67c34276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b583ef5f-a059-4934-b450-770bab8c9ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b583ef5f-a059-4934-b450-770bab8c9ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf11e69-1d50-465e-91e7-4f66065c91b3', 'volume_name': 'volume-acf11e69-1d50-465e-91e7-4f66065c91b3', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf7da85-adcd-436f-ad0d-95765315eabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf7da85-adcd-436f-ad0d-95765315eabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b0898f-8a5a-41b4-93bb-14ec5444a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:58 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Volume acf11e69-1d50-465e-91e7-4f66065c91b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf11e69-1d50-465e-91e7-4f66065c91b3', 'volume_size': 1} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1869508342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf11e69-1d50-465e-91e7-4f66065c91b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fca632ea2aad47668b4cb61a2891369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:58Z,use_quota=True,user_id='6abca93dfe6e4944ba411db63e9b7235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Creating volume acf11e69-1d50-465e-91e7-4f66065c91b3 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:16:58 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:58 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:58 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 1073741824 Apr 16 22:16:58 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.746s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.manager [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:16:58 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Deleted volume successfully. Apr 16 22:16:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-e1e4d891-e1ea-46a7-94d9-fad8e6d9f55a req-769c20de-6ed9-4e4a-b1a8-41a6da7fad96 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "cinder-b2a11816-449e-4595-90bc-e27f7c6d9684-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:16:59 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 1073741824" returned: 0 in 0.895s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:59 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 Apr 16 22:16:59 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Flow 'volume_create_manager' (3a0c8ac5-a6cb-4e3c-b6df-352ada3aa4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42398098-f7a5-4732-a1fe-927cf6610f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42398098-f7a5-4732-a1fe-927cf6610f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-951837450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9489d8f-c303-444c-ba47-48aa8f8d4a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='801ba5752e5445719d1d420093cf056e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:59Z,use_quota=True,user_id='5f40d772b5f64cfa8d771cea696fdbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaede66-3960-492e-8220-c10023213e8d),volume_type_id=ebaede66-3960-492e-8220-c10023213e8d)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5357697d-f44f-4e0c-a0cc-2eb387f6ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5357697d-f44f-4e0c-a0cc-2eb387f6ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90ea0b8-8309-4e85-b6b1-e0f21952ec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90ea0b8-8309-4e85-b6b1-e0f21952ec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9489d8f-c303-444c-ba47-48aa8f8d4a0d', 'volume_name': 'volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d1c8df-0dd7-4cf9-b2e4-54d6941c3fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d1c8df-0dd7-4cf9-b2e4-54d6941c3fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4088458c-6f33-48fa-8399-fafc9b1c5917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:59 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Volume c9489d8f-c303-444c-ba47-48aa8f8d4a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d', 'volume_size': 1} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:59 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3" returned: 0 in 0.567s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-951837450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9489d8f-c303-444c-ba47-48aa8f8d4a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='801ba5752e5445719d1d420093cf056e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:16:59Z,use_quota=True,user_id='5f40d772b5f64cfa8d771cea696fdbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaede66-3960-492e-8220-c10023213e8d),volume_type_id=ebaede66-3960-492e-8220-c10023213e8d)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Creating volume c9489d8f-c303-444c-ba47-48aa8f8d4a0d {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:16:59 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:16:59 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d 1073741824 Apr 16 22:16:59 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b0898f-8a5a-41b4-93bb-14ec5444a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf11e69-1d50-465e-91e7-4f66065c91b3', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c462fbe9-2e72-40c9-b7fb-b8d1dab83d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:16:59 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Volume volume-acf11e69-1d50-465e-91e7-4f66065c91b3 (acf11e69-1d50-465e-91e7-4f66065c91b3): created successfully Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c462fbe9-2e72-40c9-b7fb-b8d1dab83d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:16:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Flow 'volume_create_manager' (3b5fb140-31ba-4e33-a140-3f02a2a0c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:16:59 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-17236ece-3ae3-4744-8578-b41044c733dd tempest-VolumesTestJSON-1171268979 None] Created volume successfully. Apr 16 22:17:00 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d 1073741824" returned: 0 in 0.922s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:00 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d Apr 16 22:17:00 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Acquiring lock "cinder-acf11e69-1d50-465e-91e7-4f66065c91b3-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Lock "cinder-acf11e69-1d50-465e-91e7-4f66065c91b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:01 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d" returned: 0 in 0.549s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4088458c-6f33-48fa-8399-fafc9b1c5917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc24e464-d2f2-41e6-b365-9edf72135dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Acquiring lock "cinder-quobyte-acf11e69-1d50-465e-91e7-4f66065c91b3" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:01 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Volume volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d (c9489d8f-c303-444c-ba47-48aa8f8d4a0d): created successfully Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc24e464-d2f2-41e6-b365-9edf72135dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Flow 'volume_create_manager' (3a0c8ac5-a6cb-4e3c-b6df-352ada3aa4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Lock "cinder-quobyte-acf11e69-1d50-465e-91e7-4f66065c91b3" acquired by "delete_volume" :: waited 0.033s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:01 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c92ff37f-0fce-4b97-9ef0-305490a894ea tempest-VolumeTypesAccessTest-1892005730 None] Created volume successfully. Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9206668d-f4f6-4b26-8761-d9ac6749cb97]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:01 devstack sudo[85866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 Apr 16 22:17:01 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Acquiring lock "cinder-c9489d8f-c303-444c-ba47-48aa8f8d4a0d-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Lock "cinder-c9489d8f-c303-444c-ba47-48aa8f8d4a0d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Acquiring lock "cinder-quobyte-c9489d8f-c303-444c-ba47-48aa8f8d4a0d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Lock "cinder-quobyte-c9489d8f-c303-444c-ba47-48aa8f8d4a0d" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9239332-efa5-426e-92db-99e29aafe9b3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:02 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3" returned: 0 in 0.774s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:02 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d Apr 16 22:17:02 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:02 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3 Apr 16 22:17:02 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:02 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d" returned: 0 in 0.746s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:02 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d Apr 16 22:17:02 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:02 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-acf11e69-1d50-465e-91e7-4f66065c91b3" returned: 0 in 0.865s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Lock "cinder-quobyte-acf11e69-1d50-465e-91e7-4f66065c91b3" released by "delete_volume" :: held 1.682s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Created reservations ['b4b84fe3-229f-4f70-af2d-c2532be93747', '4e7fee70-4c9b-4cd3-8157-436df0897ad6', '326ce7c6-925b-40d3-9bc6-3efce6b5dae4', '57f96f1f-3046-45ef-ad99-cabd0509e353'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:03 devstack sudo[85886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:03 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "cinder-18be1025-da2f-4f2c-ba61-c658d03542f6-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Lock "cinder-18be1025-da2f-4f2c-ba61-c658d03542f6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "cinder-quobyte-18be1025-da2f-4f2c-ba61-c658d03542f6" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Lock "cinder-quobyte-18be1025-da2f-4f2c-ba61-c658d03542f6" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:03 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c9489d8f-c303-444c-ba47-48aa8f8d4a0d" returned: 0 in 0.829s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea527aa-1958-41b9-87e7-c038e8d604e1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Lock "cinder-quobyte-c9489d8f-c303-444c-ba47-48aa8f8d4a0d" released by "delete_volume" :: held 1.647s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:03 devstack cinder-volume[82650]: WARNING cinder.quota [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-253518896 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-253518896, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:17:03 devstack cinder-volume[82650]: WARNING cinder.quota [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-253518896 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-253518896, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Created reservations ['e26bbf21-fc7a-44fe-99b4-fb3ae4caf18a', 'f1e44a97-6c43-40f7-ab80-c6b7df1b4226', '0b070520-0a39-416f-a7a2-5899a348dfcc', '80b4152a-b927-45ea-8cbb-240800b11ffc'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:03 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 Apr 16 22:17:03 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:03 devstack sudo[85892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:03 devstack sudo[85892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:03 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.720s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:03 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Deleted volume successfully. Apr 16 22:17:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95d4d88a-e5cd-41a8-8a8f-1b52366fa4ad tempest-VolumesTestJSON-1171268979 None] Lock "cinder-acf11e69-1d50-465e-91e7-4f66065c91b3-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:04 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6" returned: 0 in 0.818s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:04 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6 Apr 16 22:17:04 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:04 devstack sudo[85892]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.751s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:04 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:04 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Deleted volume successfully. Apr 16 22:17:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-da951f55-0cf8-4849-992c-b327f528c55b tempest-VolumeTypesAccessTest-1892005730 None] Lock "cinder-c9489d8f-c303-444c-ba47-48aa8f8d4a0d-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:04 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-18be1025-da2f-4f2c-ba61-c658d03542f6" returned: 0 in 0.628s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Lock "cinder-quobyte-18be1025-da2f-4f2c-ba61-c658d03542f6" released by "delete_volume" :: held 1.502s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Created reservations ['dc3730b1-c2cc-42c6-a059-1b10ddbe9323', '998097ec-e583-4f30-99ca-62b21a083fbb', '9bba8892-3054-458f-8498-37499cef3acd', '001786d1-c2d8-4967-9e58-6d5da3131352'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:05 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:05 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "cinder-d8336f7c-bc78-48d1-af52-20d3868342e7-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Lock "cinder-d8336f7c-bc78-48d1-af52-20d3868342e7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "cinder-quobyte-d8336f7c-bc78-48d1-af52-20d3868342e7" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Lock "cinder-quobyte-d8336f7c-bc78-48d1-af52-20d3868342e7" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfcbaf4-9d5b-4da9-a095-b05bc29e426f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:05 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.726s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Deleted volume successfully. Apr 16 22:17:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6306c4e0-82f3-49f8-84d0-8abf5ede5cc4 tempest-VolumesTestJSON-1171268979 None] Lock "cinder-18be1025-da2f-4f2c-ba61-c658d03542f6-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:05 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 Apr 16 22:17:05 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:06 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7" returned: 0 in 0.766s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:06 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7 Apr 16 22:17:06 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:07 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d8336f7c-bc78-48d1-af52-20d3868342e7" returned: 0 in 0.706s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Lock "cinder-quobyte-d8336f7c-bc78-48d1-af52-20d3868342e7" released by "delete_volume" :: held 1.558s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Created reservations ['fa929593-b0e8-4434-8be6-15b336768ca7', '07e90fcc-f8f3-4fa5-a738-5e1c2c056047', '24a62428-a2f6-4b52-b08f-4d106ccd9bae', '83735317-2bfb-456b-9979-0dd12dee10bd'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:07 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:07 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:08 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.764s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:08 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Deleted volume successfully. Apr 16 22:17:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2b1bc116-915b-4832-883c-21e84e0ab6d3 tempest-VolumesTestJSON-1171268979 None] Lock "cinder-d8336f7c-bc78-48d1-af52-20d3868342e7-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:09 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-bfe90945-7830-407b-a257-1a67f757e9f6 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Terminate volume connection completed successfully. Apr 16 22:17:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-bfe90945-7830-407b-a257-1a67f757e9f6 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Deleting attachment 21045c9c-0096-498c-b221-a247853af239. {{(pid=82650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Apr 16 22:17:10 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "cinder-949f3543-b456-4fab-8701-0150b1bdcf39-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:10 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "cinder-949f3543-b456-4fab-8701-0150b1bdcf39-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:10 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "cinder-quobyte-949f3543-b456-4fab-8701-0150b1bdcf39" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:10 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "cinder-quobyte-949f3543-b456-4fab-8701-0150b1bdcf39" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:10 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c97982-0136-48a5-ab86-12efa80e1890]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:10 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 Apr 16 22:17:10 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:10 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39" returned: 0 in 0.667s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:10 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39 Apr 16 22:17:10 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:11 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-949f3543-b456-4fab-8701-0150b1bdcf39" returned: 0 in 0.580s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "cinder-quobyte-949f3543-b456-4fab-8701-0150b1bdcf39" released by "delete_volume" :: held 1.285s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG cinder.quota [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Created reservations ['ad2c7004-1034-40b6-9f86-7af5ad9d8b30', 'e017d24f-9852-4602-ad82-d7d28505b803', 'd9a36a3d-190d-4ace-a98b-ef67f5088a5c', '94d7ad9d-24fe-4ee4-b4b1-5219d8ee5b80'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:11 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:11 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:12 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.620s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.manager [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:12 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Deleted volume successfully. Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-665a6cb0-879b-4dfb-85ff-9b65602ed807 req-1e02324f-13f0-45ca-b79d-c8c383ef3c09 tempest-ServerBootFromVolumeStableRescueTest-995691592 None] Lock "cinder-949f3543-b456-4fab-8701-0150b1bdcf39-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Flow 'volume_create_manager' (887840d8-f54c-435a-aa57-1576f9dfdbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f5fb4d-4a0e-4cb3-be82-7c76ae32901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f5fb4d-4a0e-4cb3-be82-7c76ae32901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-541426236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acdb64e-c6c0-4968-a0a3-13dd33366c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214c4620aa04d1cb065da95122c19e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:13Z,use_quota=True,user_id='aabc164ed1a045d89e276ae3fde81743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e922f483-d365-478d-a160-c56b900b8f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e922f483-d365-478d-a160-c56b900b8f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac06ecb-502d-4adc-acc9-4fc70317bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac06ecb-502d-4adc-acc9-4fc70317bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9acdb64e-c6c0-4968-a0a3-13dd33366c22', 'volume_name': 'volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44db56e-4360-4996-b623-8c80b00382ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44db56e-4360-4996-b623-8c80b00382ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c87d8a1-4bb6-434e-b220-d649ee0f6da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:12 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Volume 9acdb64e-c6c0-4968-a0a3-13dd33366c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22', 'volume_size': 1} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-541426236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acdb64e-c6c0-4968-a0a3-13dd33366c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214c4620aa04d1cb065da95122c19e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:13Z,use_quota=True,user_id='aabc164ed1a045d89e276ae3fde81743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Creating volume 9acdb64e-c6c0-4968-a0a3-13dd33366c22 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:17:12 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:17:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:12 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 1073741824 Apr 16 22:17:12 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b038b98-c2f6-428e-9609-e902cbf78da6 tempest-BackendsCapabilitiesAdminTestsJSON-2036149426 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327690124512, 'free_capacity_gb': 1775.7327690124512, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82650) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Apr 16 22:17:13 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 1073741824" returned: 0 in 0.874s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:13 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 Apr 16 22:17:13 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-7474e3c3-2048-4d42-9fb8-539f0e566c0e tempest-BackendsCapabilitiesAdminTestsJSON-2036149426 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327690124512, 'free_capacity_gb': 1775.7327690124512, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82650) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Apr 16 22:17:14 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22" returned: 0 in 0.694s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:17:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c87d8a1-4bb6-434e-b220-d649ee0f6da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff49991b-6778-4381-8ba9-e634e4346777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:14 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Volume volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 (9acdb64e-c6c0-4968-a0a3-13dd33366c22): created successfully Apr 16 22:17:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff49991b-6778-4381-8ba9-e634e4346777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Flow 'volume_create_manager' (887840d8-f54c-435a-aa57-1576f9dfdbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:14 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f3c5e333-0ef7-4788-b11e-39d0155c9d28 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Created volume successfully. Apr 16 22:17:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Acquiring lock "cinder-9acdb64e-c6c0-4968-a0a3-13dd33366c22-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "cinder-9acdb64e-c6c0-4968-a0a3-13dd33366c22-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Acquiring lock "cinder-quobyte-9acdb64e-c6c0-4968-a0a3-13dd33366c22" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "cinder-quobyte-9acdb64e-c6c0-4968-a0a3-13dd33366c22" acquired by "delete_volume" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b82d72-1316-4ede-98a0-c305ebb6bef4]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:16 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 Apr 16 22:17:16 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:16 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22" returned: 0 in 0.862s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:17 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22 Apr 16 22:17:17 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:17 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9acdb64e-c6c0-4968-a0a3-13dd33366c22" returned: 0 in 0.674s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "cinder-quobyte-9acdb64e-c6c0-4968-a0a3-13dd33366c22" released by "delete_volume" :: held 1.570s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Created reservations ['dee8bf6a-aa0c-4e2a-acaf-c3653f14d583', '1bf3c116-d1bc-4e32-b9f0-5cb921c343a4', '8c3b30b4-2e08-495e-a911-f4cdc96206cc', '1774fad1-90cb-491e-9633-b1ee51446b9a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:17 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:17 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:18 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.731s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:18 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:18 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Deleted volume successfully. Apr 16 22:17:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-53df32e0-38b2-45c3-ae77-cd90119a23a2 tempest-VolumeQuotasNegativeTestJSON-561157603 None] Lock "cinder-9acdb64e-c6c0-4968-a0a3-13dd33366c22-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:19 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-944dda8d-b50d-4012-9d01-fa176b94737f tempest-GroupSnapshotsTest-433072095 None] Group tempest-GroupSnapshotsTest-Group-1918002540: creating Apr 16 22:17:19 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-944dda8d-b50d-4012-9d01-fa176b94737f tempest-GroupSnapshotsTest-433072095 None] Group tempest-GroupSnapshotsTest-Group-1918002540: created successfully Apr 16 22:17:19 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-944dda8d-b50d-4012-9d01-fa176b94737f tempest-GroupSnapshotsTest-433072095 None] Create group completed successfully. Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:INSERT=29,cinder:UPDATE=117,cinder:SELECT=102,cinder:DELETE=8 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=94,cinder:INSERT=38,cinder:UPDATE=144,cinder:DELETE=11 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Flow 'volume_create_manager' (0cabfb71-8755-4505-b676-b9a7ee1bd5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88efdfc4-590a-4d10-9e06-d49b56a78d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88efdfc4-590a-4d10-9e06-d49b56a78d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395205983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63be34bb-9f3c-480e-b83f-c9f727689db6,host='devstack@QuobyteHD#QuobyteHD',id=3991b483-d581-4d9a-9f65-ac97bb29bc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d14e215d294150b37c8eae32ab0ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:21Z,use_quota=True,user_id='7fb32d864bad4aa6a724fe8fce259459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d7f450c-99d7-4e7f-9545-38f280697496),volume_type_id=2d7f450c-99d7-4e7f-9545-38f280697496)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6089a288-5c2d-4687-ba34-ab6d7115bf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6089a288-5c2d-4687-ba34-ab6d7115bf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f354b358-4737-4c99-8660-1f2768d25003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f354b358-4737-4c99-8660-1f2768d25003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3991b483-d581-4d9a-9f65-ac97bb29bc54', 'volume_name': 'volume-3991b483-d581-4d9a-9f65-ac97bb29bc54', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777ce803-1401-4637-9d50-f7ed23bc4714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777ce803-1401-4637-9d50-f7ed23bc4714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd30bcb-913e-4864-941c-5e3167b901a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:20 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Volume 3991b483-d581-4d9a-9f65-ac97bb29bc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3991b483-d581-4d9a-9f65-ac97bb29bc54', 'volume_size': 1} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63be34bb-9f3c-480e-b83f-c9f727689db6,created_at=2026-04-16T20:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395205983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63be34bb-9f3c-480e-b83f-c9f727689db6,host='devstack@QuobyteHD#QuobyteHD',id=3991b483-d581-4d9a-9f65-ac97bb29bc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d14e215d294150b37c8eae32ab0ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:21Z,use_quota=True,user_id='7fb32d864bad4aa6a724fe8fce259459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d7f450c-99d7-4e7f-9545-38f280697496),volume_type_id=2d7f450c-99d7-4e7f-9545-38f280697496)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Creating volume 3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:17:20 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:17:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:21 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 1073741824 Apr 16 22:17:21 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:21 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 1073741824" returned: 0 in 0.860s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:21 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 Apr 16 22:17:21 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:22 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54" returned: 0 in 0.580s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:17:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd30bcb-913e-4864-941c-5e3167b901a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3991b483-d581-4d9a-9f65-ac97bb29bc54', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9190dd-0d75-4f77-b828-a8a998e1f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:22 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Volume volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 (3991b483-d581-4d9a-9f65-ac97bb29bc54): created successfully Apr 16 22:17:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9190dd-0d75-4f77-b828-a8a998e1f66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Flow 'volume_create_manager' (0cabfb71-8755-4505-b676-b9a7ee1bd5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:22 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ebb00bd4-ad22-4d80-992f-143f535c8239 tempest-GroupSnapshotsTest-433072095 None] Created volume successfully. Apr 16 22:17:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] GroupSnapshot 27d3ed48-66ae-4d73-8f37-def690f45b8c: creating. Apr 16 22:17:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Group snapshot 27d3ed48-66ae-4d73-8f37-def690f45b8c: creating. {{(pid=82650) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Apr 16 22:17:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Creating offline snapshot aee6bb2c-29a1-483b-8a57-2bd394b5167a of volume 3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:17:23 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fbbbf5-cd37-4f2c-b884-d2d1019a43bc]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:23 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 Apr 16 22:17:23 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:24 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54" returned: 0 in 0.792s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:24 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a 1G Apr 16 22:17:24 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:24 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:24 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Flow 'volume_create_manager' (42dc629e-4fee-40dc-9248-a7307551880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a74af0-e9a7-4e4c-ac49-bba93de19ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:25 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a74af0-e9a7-4e4c-ac49-bba93de19ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-720347945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a10ee48-b541-44cd-bc95-16e5de5b7e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d693e6c4b57425d8537d3ee06e662cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:25Z,use_quota=True,user_id='9e31105a4e74431f81eb5aa9089f1f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:25 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2378e6a5-15aa-44a5-9b20-146acc491345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2378e6a5-15aa-44a5-9b20-146acc491345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09487e4c-7d83-4703-bf0c-e90d4bfb9dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09487e4c-7d83-4703-bf0c-e90d4bfb9dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a10ee48-b541-44cd-bc95-16e5de5b7e48', 'volume_name': 'volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafa227f-f7b2-45f5-af58-e3f61b0cfe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafa227f-f7b2-45f5-af58-e3f61b0cfe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8488632d-6762-4348-a4eb-52e539ebbc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:25 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Volume 5a10ee48-b541-44cd-bc95-16e5de5b7e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48', 'volume_size': 1} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.957s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a 1G" returned: 0 in 1.051s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:17:25 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a Apr 16 22:17:25 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:25 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a" returned: 0 in 0.547s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:25 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:17:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:25 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a Apr 16 22:17:25 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:26 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a" returned: 0 in 0.605s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:26 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.info Apr 16 22:17:26 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:27 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.info" returned: 0 in 0.664s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:27 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:27 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.info Apr 16 22:17:27 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:27 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.info" returned: 0 in 0.699s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.595s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-720347945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a10ee48-b541-44cd-bc95-16e5de5b7e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d693e6c4b57425d8537d3ee06e662cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:25Z,use_quota=True,user_id='9e31105a4e74431f81eb5aa9089f1f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Creating volume 5a10ee48-b541-44cd-bc95-16e5de5b7e48 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:17:27 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:17:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:27 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 1073741824 Apr 16 22:17:27 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-53002922-53af-448e-995f-e2c1bf09dac7 tempest-GroupSnapshotsTest-433072095 None] group_snapshot 27d3ed48-66ae-4d73-8f37-def690f45b8c: created successfully Apr 16 22:17:28 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 1073741824" returned: 0 in 0.950s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:28 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 Apr 16 22:17:28 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:29 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48" returned: 0 in 0.795s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:17:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8488632d-6762-4348-a4eb-52e539ebbc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d0d61d-0baa-498b-8209-91aba15701c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:29 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Volume volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 (5a10ee48-b541-44cd-bc95-16e5de5b7e48): created successfully Apr 16 22:17:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d0d61d-0baa-498b-8209-91aba15701c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Flow 'volume_create_manager' (42dc629e-4fee-40dc-9248-a7307551880f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:29 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5712d06b-c646-4c40-bd4e-8d25fd56a5e8 tempest-SnapshotMetadataTestJSON-431637642 None] Created volume successfully. Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-aee6bb2c-29a1-483b-8a57-2bd394b5167a-73b06532-8507-4ee9-b4db-2528ff2f826c" by "_create_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-aee6bb2c-29a1-483b-8a57-2bd394b5167a-73b06532-8507-4ee9-b4db-2528ff2f826c" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Creating volume 73b06532-8507-4ee9-b4db-2528ff2f826c from snapshot aee6bb2c-29a1-483b-8a57-2bd394b5167a {{(pid=82650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-73b06532-8507-4ee9-b4db-2528ff2f826c" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-73b06532-8507-4ee9-b4db-2528ff2f826c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] snapshot: aee6bb2c-29a1-483b-8a57-2bd394b5167a, volume: 73b06532-8507-4ee9-b4db-2528ff2f826c, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbcaf8a-f91c-47c6-bd12-892af15ab17a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:30 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a Apr 16 22:17:30 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:30 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a" returned: 0 in 0.733s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3991b483-d581-4d9a-9f65-ac97bb29bc54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[534649a4-0ed1-4dd1-9d24-6da5ce86100e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:30 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 Apr 16 22:17:30 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:31 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54" returned: 0 in 0.798s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:31 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:17:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:31 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c Apr 16 22:17:31 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:35 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c" returned: 0 in 4.223s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:35 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[21930ac3-3f25-4737-9096-89a3cf7d56ef]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:36 devstack sudo[86082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 Apr 16 22:17:36 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:36 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54" returned: 0 in 0.894s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:36 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:17:36 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Converted 1024.00 MB image at 242.39 MB/s Apr 16 22:17:36 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:17:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:36 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c Apr 16 22:17:36 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:37 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c" returned: 0 in 0.653s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-73b06532-8507-4ee9-b4db-2528ff2f826c" released by "_copy_volume_from_snapshot" :: held 7.410s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-aee6bb2c-29a1-483b-8a57-2bd394b5167a-73b06532-8507-4ee9-b4db-2528ff2f826c" released by "_create_volume_from_snapshot" :: held 7.462s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.495s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.641s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Creating offline snapshot e0671055-9276-4c1d-b4c4-662ec87ac514 of volume 5a10ee48-b541-44cd-bc95-16e5de5b7e48 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:17:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c480470-cbaa-400d-8eae-79ad48096bea]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8b0c8171-9fc5-4c2d-b85e-cd87bbb554fb tempest-GroupSnapshotsTest-433072095 None] Create group from source-snapshot-27d3ed48-66ae-4d73-8f37-def690f45b8c completed successfully. Apr 16 22:17:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:37 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 Apr 16 22:17:37 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:38 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48" returned: 0 in 0.706s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:38 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 1G Apr 16 22:17:38 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-73b06532-8507-4ee9-b4db-2528ff2f826c" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-73b06532-8507-4ee9-b4db-2528ff2f826c" acquired by "delete_volume" :: waited 0.024s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:38 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3066f748-9834-45ac-961f-167fcf3f3afb]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:38 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c Apr 16 22:17:38 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:39 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 1G" returned: 0 in 0.960s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:39 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 Apr 16 22:17:39 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:39 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c" returned: 0 in 0.859s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:39 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c Apr 16 22:17:39 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:40 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514" returned: 0 in 0.776s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:40 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 is being set with open permissions: ugo+rw Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:40 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 Apr 16 22:17:40 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:40 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-73b06532-8507-4ee9-b4db-2528ff2f826c" returned: 0 in 0.907s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-73b06532-8507-4ee9-b4db-2528ff2f826c" released by "delete_volume" :: held 1.842s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Created reservations ['3298b9ba-ef64-4a47-8db3-d183a5c486f1'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:40 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514" returned: 0 in 0.710s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:40 devstack cinder-volume[82650]: WARNING cinder.quota [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1887221177 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1887221177, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:17:40 devstack cinder-volume[82650]: WARNING cinder.quota [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1887221177 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1887221177, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Created reservations ['bbec75ac-3b2f-44b8-b04b-7357e1a9a45a', '62f1f76c-000d-415a-b028-9d28d22b4fc2', 'f134bfdc-5df0-403d-8f5e-3ea12e7564a2', '2cab2b19-d772-467d-9a38-fd7d3cc514f1'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:40 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.info Apr 16 22:17:40 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:41 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:41 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:41 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] group_snapshot 27d3ed48-66ae-4d73-8f37-def690f45b8c: deleting Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] group_snapshot 27d3ed48-66ae-4d73-8f37-def690f45b8c: deleting {{(pid=82650) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-3991b483-d581-4d9a-9f65-ac97bb29bc54" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-3991b483-d581-4d9a-9f65-ac97bb29bc54" acquired by "delete_snapshot" :: waited 0.063s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-aee6bb2c-29a1-483b-8a57-2bd394b5167a" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-aee6bb2c-29a1-483b-8a57-2bd394b5167a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Deleting offline snapshot aee6bb2c-29a1-483b-8a57-2bd394b5167a of volume 3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] snapshot_file for this snap is: volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[51158dd8-af3d-451e-8c50-b0ba47f4abe9]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:41 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a Apr 16 22:17:41 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:41 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.info" returned: 0 in 1.003s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:41 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.info is being set with open permissions: ugo+rw Apr 16 22:17:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:41 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.info Apr 16 22:17:41 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:42 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.067s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:42 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4a5f3966-91f8-4142-9cbf-9f86e36df1de tempest-GroupSnapshotsTest-433072095 None] Delete group completed successfully. Apr 16 22:17:42 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a" returned: 0 in 0.995s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3991b483-d581-4d9a-9f65-ac97bb29bc54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:17:42 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[52440d5b-057e-4878-bf65-0235a362de99]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:42 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 Apr 16 22:17:42 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:42 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.info" returned: 0 in 0.880s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.208s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-7288775d-61d0-45ec-aa81-bb42c394bcd2 tempest-SnapshotMetadataTestJSON-431637642 None] Create snapshot completed successfully Apr 16 22:17:43 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54" returned: 0 in 0.873s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:43 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a Apr 16 22:17:43 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:44 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a" returned: 0 in 1.129s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:44 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a Apr 16 22:17:44 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "cinder-e0671055-9276-4c1d-b4c4-662ec87ac514-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-e0671055-9276-4c1d-b4c4-662ec87ac514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "cinder-quobyte-5a10ee48-b541-44cd-bc95-16e5de5b7e48" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-quobyte-5a10ee48-b541-44cd-bc95-16e5de5b7e48" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "cinder-quobyte-e0671055-9276-4c1d-b4c4-662ec87ac514" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-quobyte-e0671055-9276-4c1d-b4c4-662ec87ac514" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Deleting offline snapshot e0671055-9276-4c1d-b4c4-662ec87ac514 of volume 5a10ee48-b541-44cd-bc95-16e5de5b7e48 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] snapshot_file for this snap is: volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce56394-8910-4bc2-930a-91eb3ff5fa37]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:45 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 Apr 16 22:17:45 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:45 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54.aee6bb2c-29a1-483b-8a57-2bd394b5167a" returned: 0 in 0.834s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-aee6bb2c-29a1-483b-8a57-2bd394b5167a" released by "_delete_snapshot" :: held 3.941s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-3991b483-d581-4d9a-9f65-ac97bb29bc54" released by "delete_snapshot" :: held 3.988s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:45 devstack cinder-volume[82650]: WARNING cinder.quota [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1887221177 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1887221177, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:17:45 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] Created reservations ['419e563e-0240-4e9d-ad85-eee236d72b1b', 'c66b3172-b182-4db2-8859-982b53eb0bff', 'cc657797-9128-455a-8b5a-d162c17ce5fe', 'b4f08a98-472b-4d3c-ac75-e26f0ab9adda'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:45 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1e2fa396-e81d-43ab-b048-d0b458620e7f tempest-GroupSnapshotsTest-433072095 None] group_snapshot 27d3ed48-66ae-4d73-8f37-def690f45b8c: deleted successfully Apr 16 22:17:45 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514" returned: 0 in 0.898s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:17:45 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e9a857-e7ee-4905-b6e3-f1086dfbfae1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:46 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 Apr 16 22:17:46 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-3991b483-d581-4d9a-9f65-ac97bb29bc54" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-3991b483-d581-4d9a-9f65-ac97bb29bc54" acquired by "delete_volume" :: waited 0.028s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:46 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aef0ae-e920-4735-9716-b2206153bc12]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:46 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 Apr 16 22:17:46 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:46 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48" returned: 0 in 0.850s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:46 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 Apr 16 22:17:46 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:47 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54" returned: 0 in 0.868s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:47 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54 Apr 16 22:17:47 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:47 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514" returned: 0 in 0.917s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:47 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514 Apr 16 22:17:47 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:48 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3991b483-d581-4d9a-9f65-ac97bb29bc54" returned: 0 in 0.836s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-3991b483-d581-4d9a-9f65-ac97bb29bc54" released by "delete_volume" :: held 1.780s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Created reservations ['bc4ce8b2-3bdc-4cfb-b8f0-8a157f6555ad'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:48 devstack cinder-volume[82650]: WARNING cinder.db.sqlalchemy.api [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1887221177'] Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Created reservations ['0335bfc4-a317-4b29-bccc-86e634385621', '0550f453-2a05-4742-9a2d-247c38f6ecbe', 'e9d61066-f3b0-4e31-a29c-0c8fac465315', 'b9aca2b6-3f52-4eb1-9143-d810775e57b6'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:48 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:48 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:48 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48.e0671055-9276-4c1d-b4c4-662ec87ac514" returned: 0 in 0.721s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-quobyte-e0671055-9276-4c1d-b4c4-662ec87ac514" released by "_delete_snapshot" :: held 3.543s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-quobyte-5a10ee48-b541-44cd-bc95-16e5de5b7e48" released by "delete_snapshot" :: held 3.571s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Created reservations ['8147f17d-6f17-4718-8ed8-55f1c87bb963', 'b73fc20b-603b-4b35-916c-108086cc477a', '23ca5c7c-67fa-4f8c-9087-dcf10fe464fa', '39b5c293-9ffe-4598-b25a-de145b28d545'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Delete snapshot completed successfully. Apr 16 22:17:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-21f93022-3f77-43a6-9bb7-fd50c4f24430 tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-e0671055-9276-4c1d-b4c4-662ec87ac514-delete_snapshot" released by "delete_snapshot" :: held 3.714s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f64c59fe-01fa-4f13-8fa4-0df6a7223958 tempest-GroupSnapshotsTest-433072095 None] Group tempest-GroupSnapshotsTest-Group-998326560: creating Apr 16 22:17:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f64c59fe-01fa-4f13-8fa4-0df6a7223958 tempest-GroupSnapshotsTest-433072095 None] Group tempest-GroupSnapshotsTest-Group-998326560: created successfully Apr 16 22:17:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f64c59fe-01fa-4f13-8fa4-0df6a7223958 tempest-GroupSnapshotsTest-433072095 None] Create group completed successfully. Apr 16 22:17:49 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.727s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:49 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b7b5cb2d-5b7d-4e5a-95f1-f99a84488407 tempest-GroupSnapshotsTest-433072095 None] Delete group completed successfully. Apr 16 22:17:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "cinder-5a10ee48-b541-44cd-bc95-16e5de5b7e48-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-5a10ee48-b541-44cd-bc95-16e5de5b7e48-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "cinder-quobyte-5a10ee48-b541-44cd-bc95-16e5de5b7e48" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:17:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-quobyte-5a10ee48-b541-44cd-bc95-16e5de5b7e48" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:17:49 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c376dc-fe64-4d9e-b708-813ed4fa567e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:17:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:49 devstack sudo[86187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 Apr 16 22:17:49 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:50 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48" returned: 0 in 0.759s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:50 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48 Apr 16 22:17:50 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Flow 'volume_create_manager' (e69cce3a-949f-40b9-9557-ea5f88122a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d2da13-09a2-4130-a0ef-18e9f0babef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d2da13-09a2-4130-a0ef-18e9f0babef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-724007598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c81f3ea-5c75-4da5-a9d1-871f1722fb38,host='devstack@QuobyteHD#QuobyteHD',id=276a6f1f-e965-428f-9117-100627753504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d14e215d294150b37c8eae32ab0ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:50Z,use_quota=True,user_id='7fb32d864bad4aa6a724fe8fce259459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33aba0bb-a11e-4368-b56c-0b515b1d2fe4),volume_type_id=33aba0bb-a11e-4368-b56c-0b515b1d2fe4)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b47972-47a4-446d-8da2-529e9136897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b47972-47a4-446d-8da2-529e9136897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf54c2b0-273c-48f0-9e71-80ee4f50edbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf54c2b0-273c-48f0-9e71-80ee4f50edbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276a6f1f-e965-428f-9117-100627753504', 'volume_name': 'volume-276a6f1f-e965-428f-9117-100627753504', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e239d608-e13f-49c6-b2bc-f12f79c6a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e239d608-e13f-49c6-b2bc-f12f79c6a186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055b635d-e704-4c66-bded-aa83d6526fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:50 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Volume 276a6f1f-e965-428f-9117-100627753504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276a6f1f-e965-428f-9117-100627753504', 'volume_size': 1} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c81f3ea-5c75-4da5-a9d1-871f1722fb38,created_at=2026-04-16T20:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-724007598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c81f3ea-5c75-4da5-a9d1-871f1722fb38,host='devstack@QuobyteHD#QuobyteHD',id=276a6f1f-e965-428f-9117-100627753504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d14e215d294150b37c8eae32ab0ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:50Z,use_quota=True,user_id='7fb32d864bad4aa6a724fe8fce259459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33aba0bb-a11e-4368-b56c-0b515b1d2fe4),volume_type_id=33aba0bb-a11e-4368-b56c-0b515b1d2fe4)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Creating volume 276a6f1f-e965-428f-9117-100627753504 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:17:50 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:50 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 1073741824 Apr 16 22:17:50 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:50 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5a10ee48-b541-44cd-bc95-16e5de5b7e48" returned: 0 in 0.706s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-quobyte-5a10ee48-b541-44cd-bc95-16e5de5b7e48" released by "delete_volume" :: held 1.531s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Created reservations ['84b43ba6-3f45-4018-8049-32b6c1d432bf', 'edbf9aa5-8555-42cc-b50b-11ccd26de003', '1caef776-384e-480b-af41-838f95b10f21', 'd6b94d99-1755-481b-be83-14e824e0497e'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:50 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:17:50 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:51 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 1073741824" returned: 0 in 0.876s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:51 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 Apr 16 22:17:51 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:51 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.021s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:51 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:17:51 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Deleted volume successfully. Apr 16 22:17:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed82a88b-e9b5-4b69-ba3f-e08df288170a tempest-SnapshotMetadataTestJSON-431637642 None] Lock "cinder-5a10ee48-b541-44cd-bc95-16e5de5b7e48-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:17:52 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504" returned: 0 in 0.869s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:17:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055b635d-e704-4c66-bded-aa83d6526fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276a6f1f-e965-428f-9117-100627753504', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1e5cc3-0b81-47bf-9952-fadc94619fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:52 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Volume volume-276a6f1f-e965-428f-9117-100627753504 (276a6f1f-e965-428f-9117-100627753504): created successfully Apr 16 22:17:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1e5cc3-0b81-47bf-9952-fadc94619fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Flow 'volume_create_manager' (e69cce3a-949f-40b9-9557-ea5f88122a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:52 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-58428111-2792-4e5d-85c0-2ccddc7b8cde tempest-GroupSnapshotsTest-433072095 None] Created volume successfully. Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Flow 'volume_create_manager' (04bf1c4f-04a5-4a9c-9944-bcc84cc47dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6652e7e-2b17-4d2d-8280-c627c94fde6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6652e7e-2b17-4d2d-8280-c627c94fde6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-670569889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c81f3ea-5c75-4da5-a9d1-871f1722fb38,host='devstack@QuobyteHD#QuobyteHD',id=8d84d3e5-700c-473f-8ebd-48f113be5d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d14e215d294150b37c8eae32ab0ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:53Z,use_quota=True,user_id='7fb32d864bad4aa6a724fe8fce259459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33aba0bb-a11e-4368-b56c-0b515b1d2fe4),volume_type_id=33aba0bb-a11e-4368-b56c-0b515b1d2fe4)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d73f7a-a456-4c5e-a69c-bd0886acd363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d73f7a-a456-4c5e-a69c-bd0886acd363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1532d679-ed45-41f4-aadf-b252fb9e0216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1532d679-ed45-41f4-aadf-b252fb9e0216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d84d3e5-700c-473f-8ebd-48f113be5d6e', 'volume_name': 'volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4a9d2d-eddb-4f34-b37b-892b4263efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4a9d2d-eddb-4f34-b37b-892b4263efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bce940-484c-48c6-8cba-3b2dbe162f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:53 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Volume 8d84d3e5-700c-473f-8ebd-48f113be5d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e', 'volume_size': 1} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c81f3ea-5c75-4da5-a9d1-871f1722fb38,created_at=2026-04-16T20:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-670569889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c81f3ea-5c75-4da5-a9d1-871f1722fb38,host='devstack@QuobyteHD#QuobyteHD',id=8d84d3e5-700c-473f-8ebd-48f113be5d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d14e215d294150b37c8eae32ab0ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:17:53Z,use_quota=True,user_id='7fb32d864bad4aa6a724fe8fce259459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33aba0bb-a11e-4368-b56c-0b515b1d2fe4),volume_type_id=33aba0bb-a11e-4368-b56c-0b515b1d2fe4)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Creating volume 8d84d3e5-700c-473f-8ebd-48f113be5d6e {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:17:53 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:17:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:53 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e 1073741824 Apr 16 22:17:53 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:54 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e 1073741824" returned: 0 in 0.932s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:17:54 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e Apr 16 22:17:54 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:17:55 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Apr 16 22:17:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e" returned: 0 in 0.780s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:17:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:17:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:17:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bce940-484c-48c6-8cba-3b2dbe162f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df4cc6c-181b-4d04-8bd9-6408b212b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:17:55 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Volume volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e (8d84d3e5-700c-473f-8ebd-48f113be5d6e): created successfully Apr 16 22:17:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df4cc6c-181b-4d04-8bd9-6408b212b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:17:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Flow 'volume_create_manager' (04bf1c4f-04a5-4a9c-9944-bcc84cc47dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:17:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9ccc4aec-129c-4b0b-a44a-6d7fc2536a25 tempest-GroupSnapshotsTest-433072095 None] Created volume successfully. Apr 16 22:17:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-105bcc85-7882-45b7-9810-749126a60144 tempest-GroupSnapshotsTest-433072095 None] Update group completed successfully. Apr 16 22:17:56 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-49257cbc-4541-4fe6-b050-5d4eced64e91 tempest-GroupSnapshotsTest-433072095 None] Update group completed successfully. Apr 16 22:17:58 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-183b7c36-7cf0-418c-9da4-bca47d252e05 tempest-GroupSnapshotsTest-433072095 None] Update group completed successfully. Apr 16 22:17:59 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c6a0c48f-86c7-462b-adda-7f54a17a050b tempest-GroupSnapshotsTest-433072095 None] Update group completed successfully. Apr 16 22:18:00 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] GroupSnapshot f82d5aaa-d4d9-4603-a5ae-b989df1899ba: creating. Apr 16 22:18:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Group snapshot f82d5aaa-d4d9-4603-a5ae-b989df1899ba: creating. {{(pid=82650) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Apr 16 22:18:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Creating offline snapshot 32a06d26-d71b-440b-a406-b1095c6a0eb3 of volume 8d84d3e5-700c-473f-8ebd-48f113be5d6e {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:18:00 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[412c149f-e4df-4170-bd75-da51f60b24db]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:01 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e Apr 16 22:18:01 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:01 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e" returned: 0 in 0.822s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:01 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 1G Apr 16 22:18:01 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:02 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 1G" returned: 0 in 0.867s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:02 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 Apr 16 22:18:02 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:03 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3" returned: 0 in 0.777s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:03 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:18:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:03 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 Apr 16 22:18:03 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:04 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3" returned: 0 in 0.736s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:04 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.info Apr 16 22:18:04 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:04 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.info" returned: 0 in 0.727s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:04 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:18:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:04 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.info Apr 16 22:18:04 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:05 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.info" returned: 0 in 0.866s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.890s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Creating offline snapshot 490ec6ea-b2d5-444c-b05f-7f3ce757ee52 of volume 276a6f1f-e965-428f-9117-100627753504 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:18:05 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c1457a-ded7-432e-b55c-feceba32f169]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:05 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 Apr 16 22:18:05 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:06 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504" returned: 0 in 0.976s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:06 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 1G Apr 16 22:18:06 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:07 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 1G" returned: 0 in 1.041s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276a6f1f-e965-428f-9117-100627753504 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:07 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276a6f1f-e965-428f-9117-100627753504 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 Apr 16 22:18:07 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:08 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276a6f1f-e965-428f-9117-100627753504 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52" returned: 0 in 0.658s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:08 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:18:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:08 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 Apr 16 22:18:08 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:09 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52" returned: 0 in 0.920s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:09 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.info Apr 16 22:18:09 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:10 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.info" returned: 0 in 0.765s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:10 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:18:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:10 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.info Apr 16 22:18:10 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:10 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.info" returned: 0 in 0.683s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.142s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4882cdb2-2970-4d72-a4c7-15786bba0349 tempest-GroupSnapshotsTest-433072095 None] group_snapshot f82d5aaa-d4d9-4603-a5ae-b989df1899ba: created successfully Apr 16 22:18:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] group_snapshot f82d5aaa-d4d9-4603-a5ae-b989df1899ba: deleting Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] group_snapshot f82d5aaa-d4d9-4603-a5ae-b989df1899ba: deleting {{(pid=82650) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-8d84d3e5-700c-473f-8ebd-48f113be5d6e" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-8d84d3e5-700c-473f-8ebd-48f113be5d6e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-32a06d26-d71b-440b-a406-b1095c6a0eb3" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-32a06d26-d71b-440b-a406-b1095c6a0eb3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Deleting offline snapshot 32a06d26-d71b-440b-a406-b1095c6a0eb3 of volume 8d84d3e5-700c-473f-8ebd-48f113be5d6e {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] snapshot_file for this snap is: volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f1013-8d8f-4db3-b02e-c826cc8fb150]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:11 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 Apr 16 22:18:11 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:12 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3" returned: 0 in 1.078s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:18:12 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0587278-95d4-4702-be2f-bfc26a8c5c08]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:13 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e Apr 16 22:18:13 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:13 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e" returned: 0 in 1.117s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:14 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 Apr 16 22:18:14 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:14 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3" returned: 0 in 0.918s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:14 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3 Apr 16 22:18:14 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Flow 'volume_create_manager' (f7a36e30-8451-45ea-bf94-a5e7c29ed15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee156a0-4fb1-4eb2-9626-96871119f473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:15 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee156a0-4fb1-4eb2-9626-96871119f473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163832838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febf259e-2b04-4721-9dd9-fb28ae26f66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e1793f790049aea5594a92467e2643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:16Z,use_quota=True,user_id='9cc7b2569af74039bf3fbce2c2f724d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc67804a-3d9b-440b-a8ab-b2519af00a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc67804a-3d9b-440b-a8ab-b2519af00a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f022a3c5-909a-48f5-844e-467d7d78d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f022a3c5-909a-48f5-844e-467d7d78d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'febf259e-2b04-4721-9dd9-fb28ae26f66d', 'volume_name': 'volume-febf259e-2b04-4721-9dd9-fb28ae26f66d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0871b1c-9e7c-46b5-aae7-d9645cbc0ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0871b1c-9e7c-46b5-aae7-d9645cbc0ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0004d7e-dfe2-4a91-96ec-88f456fbbe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:15 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Volume febf259e-2b04-4721-9dd9-fb28ae26f66d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-febf259e-2b04-4721-9dd9-fb28ae26f66d', 'volume_size': 1} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163832838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febf259e-2b04-4721-9dd9-fb28ae26f66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e1793f790049aea5594a92467e2643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:16Z,use_quota=True,user_id='9cc7b2569af74039bf3fbce2c2f724d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Creating volume febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:18:15 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e.32a06d26-d71b-440b-a406-b1095c6a0eb3" returned: 0 in 0.868s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-32a06d26-d71b-440b-a406-b1095c6a0eb3" released by "_delete_snapshot" :: held 4.129s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-8d84d3e5-700c-473f-8ebd-48f113be5d6e" released by "delete_snapshot" :: held 4.147s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:15 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d 1073741824 Apr 16 22:18:15 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-276a6f1f-e965-428f-9117-100627753504" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-276a6f1f-e965-428f-9117-100627753504" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-490ec6ea-b2d5-444c-b05f-7f3ce757ee52" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-490ec6ea-b2d5-444c-b05f-7f3ce757ee52" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Deleting offline snapshot 490ec6ea-b2d5-444c-b05f-7f3ce757ee52 of volume 276a6f1f-e965-428f-9117-100627753504 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] snapshot_file for this snap is: volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fee7e1-ca7d-44e2-a206-f40d857d62c2]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:16 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 Apr 16 22:18:16 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:16 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d 1073741824" returned: 0 in 1.033s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:16 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52" returned: 0 in 0.961s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-276a6f1f-e965-428f-9117-100627753504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:18:16 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:18:16 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c1065-6b83-414a-9fe8-99fb48a055a5]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:17 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 Apr 16 22:18:17 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:17 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.639s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0004d7e-dfe2-4a91-96ec-88f456fbbe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-febf259e-2b04-4721-9dd9-fb28ae26f66d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cedda06-f597-4891-b2e1-0a8a399187f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:17 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Volume volume-febf259e-2b04-4721-9dd9-fb28ae26f66d (febf259e-2b04-4721-9dd9-fb28ae26f66d): created successfully Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cedda06-f597-4891-b2e1-0a8a399187f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Flow 'volume_create_manager' (f7a36e30-8451-45ea-bf94-a5e7c29ed15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:17 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a687e567-3dea-4411-ad87-1ca1bee521b7 tempest-VolumesActionsTest-199560265 None] Created volume successfully. Apr 16 22:18:17 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504" returned: 0 in 0.641s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:17 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 Apr 16 22:18:17 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:18 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52" returned: 0 in 0.560s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:18 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52 Apr 16 22:18:18 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:18 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504.490ec6ea-b2d5-444c-b05f-7f3ce757ee52" returned: 0 in 0.601s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-490ec6ea-b2d5-444c-b05f-7f3ce757ee52" released by "_delete_snapshot" :: held 2.886s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-276a6f1f-e965-428f-9117-100627753504" released by "delete_snapshot" :: held 2.901s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:18 devstack cinder-volume[82650]: WARNING cinder.quota [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-477859582 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-477859582, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:18:18 devstack cinder-volume[82650]: WARNING cinder.quota [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-477859582 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-477859582, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:18:18 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Created reservations ['ac3c7e6a-7ab4-4218-8988-209bf80cc150', '8e32347e-c6de-4a28-8fd3-b81b59f36518', '8c677060-1632-44ea-a672-9612eff38a68', '6ac2f76b-ecba-4eb9-bafb-2acaada6e198'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:18 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] Created reservations ['0d7a2ae1-50ac-489b-85b2-469dd17f0fb7', '2ebac9f1-6079-4b0c-a133-453fb4ec7794', '0d3aa924-19fa-4cd9-93e6-cac66e18314f', '1581cb67-54f7-4fdf-88a3-6d5c3b7f1508'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:18 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-720c45b3-8dc6-4d1d-8b4d-ca780d992a7b tempest-GroupSnapshotsTest-433072095 None] group_snapshot f82d5aaa-d4d9-4603-a5ae-b989df1899ba: deleted successfully Apr 16 22:18:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-276a6f1f-e965-428f-9117-100627753504" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-276a6f1f-e965-428f-9117-100627753504" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:19 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b6e04-e02d-4a88-8acb-a49d5e5b296c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:19 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 Apr 16 22:18:19 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:20 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504" returned: 0 in 0.609s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:20 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504 Apr 16 22:18:20 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:20 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-276a6f1f-e965-428f-9117-100627753504" returned: 0 in 0.544s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-276a6f1f-e965-428f-9117-100627753504" released by "delete_volume" :: held 1.258s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-8d84d3e5-700c-473f-8ebd-48f113be5d6e" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-8d84d3e5-700c-473f-8ebd-48f113be5d6e" acquired by "delete_volume" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:20 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c37e6f-e218-49fe-93c1-988b194df55f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:20 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e Apr 16 22:18:20 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:21 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e" returned: 0 in 0.710s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:21 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e Apr 16 22:18:21 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:22 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8d84d3e5-700c-473f-8ebd-48f113be5d6e" returned: 0 in 0.591s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-8d84d3e5-700c-473f-8ebd-48f113be5d6e" released by "delete_volume" :: held 1.370s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=95,cinder:UPDATE=85,cinder:DELETE=5,cinder:INSERT=19 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=88,cinder:INSERT=20,cinder:UPDATE=79,cinder:DELETE=2 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Created reservations ['de855f70-736a-43c7-96df-210d7a98f420'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:22 devstack cinder-volume[82650]: WARNING cinder.quota [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-477859582 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-477859582, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Created reservations ['c08ef393-55bf-4362-ae61-e1366aa56de9', '58759c20-194e-4e0f-9f61-069abb698945', 'f9ce27e4-8e82-49d0-89b4-fcbcc06b232b', '528eb10d-d413-4c10-9862-c94f2a9b7ae8'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Created reservations ['bbea7fb8-c21d-4496-8f8b-a0472e014ea7', '46997d67-25f8-4e11-abee-c17cc8747213', '06dc2154-bf49-4591-bae4-637b1ef62e26', 'ab79b184-2bde-4ec6-9d49-2b80b9025123'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:22 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:18:22 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-80ac0db4-e3b5-44fa-9f87-13227b41e7c5 tempest-GroupSnapshotsTest-433072095 None] Group tempest-GroupSnapshotsTest-Group-1422395183: creating Apr 16 22:18:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-80ac0db4-e3b5-44fa-9f87-13227b41e7c5 tempest-GroupSnapshotsTest-433072095 None] Group tempest-GroupSnapshotsTest-Group-1422395183: created successfully Apr 16 22:18:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-80ac0db4-e3b5-44fa-9f87-13227b41e7c5 tempest-GroupSnapshotsTest-433072095 None] Create group completed successfully. Apr 16 22:18:23 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.111s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:23 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:18:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1d5919d4-9318-4b37-ab23-a7767a77a495 tempest-GroupSnapshotsTest-433072095 None] Delete group completed successfully. Apr 16 22:18:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:18:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:24 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:18:24 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:24 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Flow 'volume_create_manager' (d2f1dd26-bbbb-41e7-80bb-2d67fd6674dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312e9bed-ef77-4a83-bbb4-af110b9985ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312e9bed-ef77-4a83-bbb4-af110b9985ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1631606830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72c42c0b-ccf0-42a8-adb4-e28923d8459f,host='devstack@QuobyteHD#QuobyteHD',id=734b82d6-cf9a-4654-8aff-5b2b46824714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d14e215d294150b37c8eae32ab0ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:25Z,use_quota=True,user_id='7fb32d864bad4aa6a724fe8fce259459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(717958b9-b69d-4000-98cf-953938d87c81),volume_type_id=717958b9-b69d-4000-98cf-953938d87c81)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be2d516-ed4f-472c-880e-d4bef09fed7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be2d516-ed4f-472c-880e-d4bef09fed7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe0c455-8ed6-404b-9e37-f2eec43cf9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe0c455-8ed6-404b-9e37-f2eec43cf9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734b82d6-cf9a-4654-8aff-5b2b46824714', 'volume_name': 'volume-734b82d6-cf9a-4654-8aff-5b2b46824714', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08af4be7-937d-41d2-b01d-97022b0b365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08af4be7-937d-41d2-b01d-97022b0b365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abe17ec-a0d0-4af7-9b07-bf0e01f7cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:25 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Volume 734b82d6-cf9a-4654-8aff-5b2b46824714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734b82d6-cf9a-4654-8aff-5b2b46824714', 'volume_size': 1} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72c42c0b-ccf0-42a8-adb4-e28923d8459f,created_at=2026-04-16T20:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1631606830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72c42c0b-ccf0-42a8-adb4-e28923d8459f,host='devstack@QuobyteHD#QuobyteHD',id=734b82d6-cf9a-4654-8aff-5b2b46824714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d14e215d294150b37c8eae32ab0ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:25Z,use_quota=True,user_id='7fb32d864bad4aa6a724fe8fce259459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(717958b9-b69d-4000-98cf-953938d87c81),volume_type_id=717958b9-b69d-4000-98cf-953938d87c81)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Creating volume 734b82d6-cf9a-4654-8aff-5b2b46824714 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:18:25 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:25 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 1073741824 Apr 16 22:18:25 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:25 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.477s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:18:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:18:26 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 1073741824" returned: 0 in 1.268s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:26 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 Apr 16 22:18:26 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:27 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714" returned: 0 in 1.128s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] <== create_volume: return (2478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:18:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.480s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abe17ec-a0d0-4af7-9b07-bf0e01f7cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734b82d6-cf9a-4654-8aff-5b2b46824714', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccc08ca-fa6f-41e8-b0c1-e481a45e48c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:27 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Volume volume-734b82d6-cf9a-4654-8aff-5b2b46824714 (734b82d6-cf9a-4654-8aff-5b2b46824714): created successfully Apr 16 22:18:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccc08ca-fa6f-41e8-b0c1-e481a45e48c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Flow 'volume_create_manager' (d2f1dd26-bbbb-41e7-80bb-2d67fd6674dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f5eb6529-69e1-4b3e-aa72-cdcb09111b36 tempest-GroupSnapshotsTest-433072095 None] Created volume successfully. Apr 16 22:18:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] GroupSnapshot 7623cd5a-1fd8-4c3a-b784-2baceb57cc7a: creating. Apr 16 22:18:28 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Group snapshot 7623cd5a-1fd8-4c3a-b784-2baceb57cc7a: creating. {{(pid=82650) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Apr 16 22:18:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Creating offline snapshot d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 of volume 734b82d6-cf9a-4654-8aff-5b2b46824714 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:18:28 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d344a299-89a2-481f-9f3d-332da3ac0341]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:28 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 Apr 16 22:18:28 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (d452e695-3287-46a9-ac4e-6efdabdb9586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bcd93b-82d5-42a6-b3e6-3f447578278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bcd93b-82d5-42a6-b3e6-3f447578278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-375794920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb88f924-b444-4487-861c-903a14335b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:29Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4bbfde-1009-4275-8cf6-de47efa0d9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4bbfde-1009-4275-8cf6-de47efa0d9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55c0e91-ee2a-4aaa-a072-461f0de7e01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55c0e91-ee2a-4aaa-a072-461f0de7e01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb88f924-b444-4487-861c-903a14335b2d', 'volume_name': 'volume-eb88f924-b444-4487-861c-903a14335b2d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf076fc-7434-4195-90df-0cf9150add11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf076fc-7434-4195-90df-0cf9150add11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc59729d-4c5e-487d-a44d-415120511dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:29 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Volume eb88f924-b444-4487-861c-903a14335b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb88f924-b444-4487-861c-903a14335b2d', 'volume_size': 1} Apr 16 22:18:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:30 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714" returned: 0 in 1.437s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:30 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 1G Apr 16 22:18:30 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:32 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 1G" returned: 0 in 2.045s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734b82d6-cf9a-4654-8aff-5b2b46824714 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:32 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734b82d6-cf9a-4654-8aff-5b2b46824714 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 Apr 16 22:18:32 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:33 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734b82d6-cf9a-4654-8aff-5b2b46824714 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27" returned: 0 in 1.323s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:33 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:18:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:33 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 Apr 16 22:18:33 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:35 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27" returned: 0 in 1.674s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:35 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.info Apr 16 22:18:35 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:36 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.info" returned: 0 in 1.254s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:36 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:18:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:36 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.info Apr 16 22:18:36 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:37 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.info" returned: 0 in 0.971s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.917s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.142s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-375794920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb88f924-b444-4487-861c-903a14335b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:29Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Creating volume eb88f924-b444-4487-861c-903a14335b2d {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:18:37 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:18:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:37 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d 1073741824 Apr 16 22:18:37 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-043c664a-853b-4d4b-9529-79e6bef5edd6 tempest-GroupSnapshotsTest-433072095 None] group_snapshot 7623cd5a-1fd8-4c3a-b784-2baceb57cc7a: created successfully Apr 16 22:18:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7fa9684-0774-4d0a-b6be-af8ced0cffb1 tempest-VolumesActionsTest-199560265 None] Acquiring lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d" by "attach_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7fa9684-0774-4d0a-b6be-af8ced0cffb1 tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d" acquired by "attach_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:38 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d7fa9684-0774-4d0a-b6be-af8ced0cffb1 tempest-VolumesActionsTest-199560265 None] Attaching volume febf259e-2b04-4721-9dd9-fb28ae26f66d to instance 220547c1-0737-42eb-938c-674434571d25 at mountpoint /dev/vdb on host None. Apr 16 22:18:38 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d7fa9684-0774-4d0a-b6be-af8ced0cffb1 tempest-VolumesActionsTest-199560265 None] Attach volume completed successfully. Apr 16 22:18:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7fa9684-0774-4d0a-b6be-af8ced0cffb1 tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d" released by "attach_volume" :: held 0.084s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:38 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] group_snapshot 7623cd5a-1fd8-4c3a-b784-2baceb57cc7a: deleting Apr 16 22:18:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5ac86f33-0d11-4572-931c-f57e0f4db716 tempest-VolumesActionsTest-199560265 None] Acquiring lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-detach_volume" by "detach_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5ac86f33-0d11-4572-931c-f57e0f4db716 tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:38 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5ac86f33-0d11-4572-931c-f57e0f4db716 tempest-VolumesActionsTest-199560265 None] Detaching volume febf259e-2b04-4721-9dd9-fb28ae26f66d from instance 220547c1-0737-42eb-938c-674434571d25. Apr 16 22:18:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] group_snapshot 7623cd5a-1fd8-4c3a-b784-2baceb57cc7a: deleting {{(pid=82650) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-734b82d6-cf9a-4654-8aff-5b2b46824714" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-734b82d6-cf9a-4654-8aff-5b2b46824714" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Deleting offline snapshot d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 of volume 734b82d6-cf9a-4654-8aff-5b2b46824714 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] snapshot_file for this snap is: volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:18:39 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5ac86f33-0d11-4572-931c-f57e0f4db716 tempest-VolumesActionsTest-199560265 None] Detach volume completed successfully. Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5ac86f33-0d11-4572-931c-f57e0f4db716 tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-detach_volume" released by "detach_volume" :: held 0.316s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[97179843-70e6-4043-9731-61b00896eee4]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:39 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d 1073741824" returned: 0 in 1.639s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:39 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 Apr 16 22:18:39 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:39 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d Apr 16 22:18:39 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:40 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27" returned: 0 in 0.904s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-734b82d6-cf9a-4654-8aff-5b2b46824714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b013e1-9843-4ce7-b3c0-d996ec404569]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:40 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 Apr 16 22:18:40 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:40 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d" returned: 0 in 1.218s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] <== create_volume: return (2948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.951s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc59729d-4c5e-487d-a44d-415120511dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb88f924-b444-4487-861c-903a14335b2d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983fd0ff-f2ee-4257-b3d5-de89bca279c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:40 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Volume volume-eb88f924-b444-4487-861c-903a14335b2d (eb88f924-b444-4487-861c-903a14335b2d): created successfully Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983fd0ff-f2ee-4257-b3d5-de89bca279c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (d452e695-3287-46a9-ac4e-6efdabdb9586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:40 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-795f79f4-7b17-4bc3-8d23-67095e131ba8 tempest-VolumesActionsTest-1459154100 None] Created volume successfully. Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-65baf72a-5596-4350-86fb-9ecef545fb71 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "cinder-eb88f924-b444-4487-861c-903a14335b2d" by "attach_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-65baf72a-5596-4350-86fb-9ecef545fb71 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-eb88f924-b444-4487-861c-903a14335b2d" acquired by "attach_volume" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:40 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-65baf72a-5596-4350-86fb-9ecef545fb71 tempest-VolumesActionsTest-1459154100 None] Attaching volume eb88f924-b444-4487-861c-903a14335b2d to instance 45de06aa-785b-4c9a-8a45-8b987715a332 at mountpoint /dev/vdb on host None. Apr 16 22:18:41 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-65baf72a-5596-4350-86fb-9ecef545fb71 tempest-VolumesActionsTest-1459154100 None] Attach volume completed successfully. Apr 16 22:18:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-65baf72a-5596-4350-86fb-9ecef545fb71 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-eb88f924-b444-4487-861c-903a14335b2d" released by "attach_volume" :: held 0.168s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:41 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714" returned: 0 in 0.908s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:41 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 Apr 16 22:18:41 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-042b2088-3136-4b41-945d-c5d7b2015c66 tempest-VolumesActionsTest-2135731517 None] Terminate volume connection completed successfully. Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Flow 'volume_create_manager' (6c538906-6f01-4571-9ab8-6fc4503536b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6be2f3-d2df-405e-b8a4-f1edbfd9f954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6be2f3-d2df-405e-b8a4-f1edbfd9f954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-69409569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0760cf-6905-48a7-8a3d-77068b0cb3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec6e3c6e30145ed8d0ef7b12aea5d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:43Z,use_quota=True,user_id='e96cd1f1db744f33b8f54c741ab36fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f535e94-15c6-41a1-9ee4-20e120b66914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f535e94-15c6-41a1-9ee4-20e120b66914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddcb9de-21de-460d-90cd-81d70412c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddcb9de-21de-460d-90cd-81d70412c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0760cf-6905-48a7-8a3d-77068b0cb3ab', 'volume_name': 'volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7e6eef-7335-4be2-8b65-33cfc8c96242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7e6eef-7335-4be2-8b65-33cfc8c96242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c87f06-f200-42f2-a019-8e0d52a15552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:42 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Volume 2e0760cf-6905-48a7-8a3d-77068b0cb3ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab', 'volume_size': 1} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-69409569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0760cf-6905-48a7-8a3d-77068b0cb3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec6e3c6e30145ed8d0ef7b12aea5d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:43Z,use_quota=True,user_id='e96cd1f1db744f33b8f54c741ab36fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Creating volume 2e0760cf-6905-48a7-8a3d-77068b0cb3ab {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:18:42 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:42 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab 1073741824 Apr 16 22:18:42 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-042b2088-3136-4b41-945d-c5d7b2015c66 tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-detach_volume" by "detach_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-042b2088-3136-4b41-945d-c5d7b2015c66 tempest-VolumesActionsTest-2135731517 None] Lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-042b2088-3136-4b41-945d-c5d7b2015c66 tempest-VolumesActionsTest-2135731517 None] Detaching volume eb88f924-b444-4487-861c-903a14335b2d from instance 45de06aa-785b-4c9a-8a45-8b987715a332. Apr 16 22:18:43 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27" returned: 0 in 1.844s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-042b2088-3136-4b41-945d-c5d7b2015c66 tempest-VolumesActionsTest-2135731517 None] Detach volume completed successfully. Apr 16 22:18:43 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27 Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-042b2088-3136-4b41-945d-c5d7b2015c66 tempest-VolumesActionsTest-2135731517 None] Lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:43 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:43 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714.d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27" returned: 0 in 0.563s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-d24a9fbc-2e7b-44a4-930c-0bc80a5ffc27" released by "_delete_snapshot" :: held 4.517s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-734b82d6-cf9a-4654-8aff-5b2b46824714" released by "delete_snapshot" :: held 4.554s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f2ee68a5-79b1-48ad-bd92-6180b695b7a0 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-detach_volume" by "detach_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f2ee68a5-79b1-48ad-bd92-6180b695b7a0 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f2ee68a5-79b1-48ad-bd92-6180b695b7a0 tempest-VolumesActionsTest-1459154100 None] Volume detach called, but volume not attached. Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f2ee68a5-79b1-48ad-bd92-6180b695b7a0 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:43 devstack cinder-volume[82650]: WARNING cinder.quota [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-101368895 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-101368895, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:18:43 devstack cinder-volume[82650]: WARNING cinder.quota [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-101368895 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-101368895, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] Created reservations ['ddb7398d-051f-4c26-94c5-392220954e84', '336268e9-c794-4ed0-9f87-b3d2076cda36', '6dd501cf-d1ef-4674-bb2b-7c4dc1c4d609', 'bec9875e-2f61-4711-8701-e7258533c247'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5eba7565-fa46-4f8a-a748-4292ace108dc tempest-GroupSnapshotsTest-433072095 None] group_snapshot 7623cd5a-1fd8-4c3a-b784-2baceb57cc7a: deleted successfully Apr 16 22:18:43 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab 1073741824" returned: 0 in 1.149s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:43 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab Apr 16 22:18:43 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "cinder-quobyte-eb88f924-b444-4487-861c-903a14335b2d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-quobyte-eb88f924-b444-4487-861c-903a14335b2d" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:44 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab" returned: 0 in 0.586s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c87f06-f200-42f2-a019-8e0d52a15552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e7a563-705f-4f38-bc65-eab51cce2a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[708153a1-ad03-4d03-a231-49abe1b94975]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:44 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Volume volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab (2e0760cf-6905-48a7-8a3d-77068b0cb3ab): created successfully Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e7a563-705f-4f38-bc65-eab51cce2a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Flow 'volume_create_manager' (6c538906-6f01-4571-9ab8-6fc4503536b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:44 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a5038d70-2127-4b2f-9b53-090f9884d608 tempest-ServersNegativeTestJSON-681776750 None] Created volume successfully. Apr 16 22:18:44 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d Apr 16 22:18:44 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "cinder-quobyte-734b82d6-cf9a-4654-8aff-5b2b46824714" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-734b82d6-cf9a-4654-8aff-5b2b46824714" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:45 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[06de5b26-26e1-41e2-8935-2661e7cd705a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:45 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 Apr 16 22:18:45 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:45 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d" returned: 0 in 1.066s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:45 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d Apr 16 22:18:45 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:46 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714" returned: 0 in 0.955s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:46 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714 Apr 16 22:18:46 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:18:46 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Flow 'volume_create_manager' (66bb54c4-30d0-44e6-b966-287c8f1acc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3b7b2e-89f9-4a49-bbdd-cc1f57b9b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3b7b2e-89f9-4a49-bbdd-cc1f57b9b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1941720043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7552513f-50f9-4e3e-a8dd-da4d615c7d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec6e3c6e30145ed8d0ef7b12aea5d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:47Z,use_quota=True,user_id='e96cd1f1db744f33b8f54c741ab36fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cbbdd7-ca4e-4d3f-b22e-e605f47533ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cbbdd7-ca4e-4d3f-b22e-e605f47533ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cee36c4-3aeb-4837-b8c0-8eaa54773802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cee36c4-3aeb-4837-b8c0-8eaa54773802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7552513f-50f9-4e3e-a8dd-da4d615c7d95', 'volume_name': 'volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c5a80d-8dd6-48fc-b66a-7a9b9eb7c9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c5a80d-8dd6-48fc-b66a-7a9b9eb7c9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3a7bf4-1576-4050-bfde-8f2a31593232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:46 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Volume 7552513f-50f9-4e3e-a8dd-da4d615c7d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95', 'volume_size': 1} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1941720043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7552513f-50f9-4e3e-a8dd-da4d615c7d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec6e3c6e30145ed8d0ef7b12aea5d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:47Z,use_quota=True,user_id='e96cd1f1db744f33b8f54c741ab36fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Creating volume 7552513f-50f9-4e3e-a8dd-da4d615c7d95 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:46 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:18:46 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb88f924-b444-4487-861c-903a14335b2d" returned: 0 in 1.187s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-734b82d6-cf9a-4654-8aff-5b2b46824714" returned: 0 in 0.746s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:46 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 1073741824 Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Lock "cinder-quobyte-734b82d6-cf9a-4654-8aff-5b2b46824714" released by "delete_volume" :: held 1.818s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:46 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-quobyte-eb88f924-b444-4487-861c-903a14335b2d" released by "delete_volume" :: held 2.373s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Created reservations ['88500812-68f4-42d9-922e-868f12e4a55b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Created reservations ['5d67a3c2-e89f-4c57-90a7-0024b7391860', 'a3e4a626-b81e-44fa-911f-bbc253fc0bf8', 'c5807371-9553-47f7-adb6-b6226265812c', 'f3ff832a-3931-4cd4-90f4-31908e3392ac'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:46 devstack cinder-volume[82650]: WARNING cinder.quota [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-101368895 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-101368895, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Created reservations ['2b67ed72-b97c-4a19-b751-eb62bf5a2ef4', '574bcb25-23e3-41f5-8e9d-efd37e80e87b', '06d61501-6556-468e-9c33-70ac2b580682', '731a8d74-a806-477b-823f-3dc95da3bfbf'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:47 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:18:47 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:47 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:18:47 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:48 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.286s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:48 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:18:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Deleted volume successfully. Apr 16 22:18:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-48fb567f-2052-4cb4-b3bd-3cb6641b6968 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-eb88f924-b444-4487-861c-903a14335b2d-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:48 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.597s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:48 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:18:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6a4cf4db-3cd6-4b95-9778-aaa0473f1b29 tempest-GroupSnapshotsTest-433072095 None] Delete group completed successfully. Apr 16 22:18:48 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 1073741824" returned: 0 in 1.915s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:48 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 Apr 16 22:18:48 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:49 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95" returned: 0 in 0.716s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:49 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] <== create_volume: return (2672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:18:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.675s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3a7bf4-1576-4050-bfde-8f2a31593232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6878df2-b93e-47fc-9797-b4582f2ae3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:49 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Volume volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 (7552513f-50f9-4e3e-a8dd-da4d615c7d95): created successfully Apr 16 22:18:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6878df2-b93e-47fc-9797-b4582f2ae3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Flow 'volume_create_manager' (66bb54c4-30d0-44e6-b966-287c8f1acc32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8a0234b6-6283-40ad-8d44-a37e5c423b3f tempest-ServersNegativeTestJSON-681776750 None] Created volume successfully. Apr 16 22:18:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "cinder-7552513f-50f9-4e3e-a8dd-da4d615c7d95-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Lock "cinder-7552513f-50f9-4e3e-a8dd-da4d615c7d95-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "cinder-quobyte-7552513f-50f9-4e3e-a8dd-da4d615c7d95" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Lock "cinder-quobyte-7552513f-50f9-4e3e-a8dd-da4d615c7d95" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:51 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e35beed-5ef0-47c5-8192-ab49461e8c21]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:51 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 Apr 16 22:18:51 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:51 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95" returned: 0 in 0.670s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:51 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95 Apr 16 22:18:51 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:52 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7552513f-50f9-4e3e-a8dd-da4d615c7d95" returned: 0 in 0.494s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Lock "cinder-quobyte-7552513f-50f9-4e3e-a8dd-da4d615c7d95" released by "delete_volume" :: held 1.247s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Created reservations ['d45189ab-1e98-4ae5-85b1-75cb3189deb8', 'e9ca39de-f456-4718-a336-074913164d09', 'ad075b70-4d7d-4af2-936c-19e357d06504', '423edf19-9fe1-4987-b2c5-b7dc61d753ab'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:52 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:18:52 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:53 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.600s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:18:53 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Deleted volume successfully. Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-319f64a2-f729-45a0-bc79-5cb3e54da827 tempest-ServersNegativeTestJSON-681776750 None] Lock "cinder-7552513f-50f9-4e3e-a8dd-da4d615c7d95-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "cinder-2e0760cf-6905-48a7-8a3d-77068b0cb3ab-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Lock "cinder-2e0760cf-6905-48a7-8a3d-77068b0cb3ab-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "cinder-quobyte-2e0760cf-6905-48a7-8a3d-77068b0cb3ab" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Lock "cinder-quobyte-2e0760cf-6905-48a7-8a3d-77068b0cb3ab" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b071b9-812c-432e-848f-25ec309168e4]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:53 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab Apr 16 22:18:53 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:53 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab" returned: 0 in 0.700s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:54 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab Apr 16 22:18:54 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:54 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2e0760cf-6905-48a7-8a3d-77068b0cb3ab" returned: 0 in 0.549s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Lock "cinder-quobyte-2e0760cf-6905-48a7-8a3d-77068b0cb3ab" released by "delete_volume" :: held 1.304s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Created reservations ['f9b9c2ed-247c-45f9-9267-67bbb0fbc226', '22a3da67-4cea-43a8-861e-3d1ac8e6c124', 'ea717bae-3bef-4f7d-bf2e-87aa1fbcdfae', '0cb1bd39-2b0f-4d6f-ba3f-a5cf037d832a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:54 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:18:54 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:55 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.956s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:55 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:18:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Deleted volume successfully. Apr 16 22:18:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa843a89-d3ee-4eb6-b70f-dda7c0a55903 tempest-ServersNegativeTestJSON-681776750 None] Lock "cinder-2e0760cf-6905-48a7-8a3d-77068b0cb3ab-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (569bf091-a48c-4c82-9edf-ae10b11ce450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5b382a-fccd-4b99-817d-1522aa4efe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5b382a-fccd-4b99-817d-1522aa4efe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-287285664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d59145-2091-4389-aa73-5d7dd55d18dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:57Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c73557-9ebe-49ca-9c48-8cc0abefd363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c73557-9ebe-49ca-9c48-8cc0abefd363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df5ad77-5e04-4694-a954-25b14a988e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df5ad77-5e04-4694-a954-25b14a988e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d59145-2091-4389-aa73-5d7dd55d18dc', 'volume_name': 'volume-f4d59145-2091-4389-aa73-5d7dd55d18dc', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c07d8a-3e4e-4d12-ab49-225f6f221b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c07d8a-3e4e-4d12-ab49-225f6f221b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb3efcc-5cda-4a70-8c02-58d7df85d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:56 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Volume f4d59145-2091-4389-aa73-5d7dd55d18dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d59145-2091-4389-aa73-5d7dd55d18dc', 'volume_size': 1} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-287285664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d59145-2091-4389-aa73-5d7dd55d18dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:18:57Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Creating volume f4d59145-2091-4389-aa73-5d7dd55d18dc {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:18:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:18:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:18:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:18:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:18:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:18:57 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:18:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:57 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc 1073741824 Apr 16 22:18:57 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:58 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc 1073741824" returned: 0 in 0.967s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:18:58 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc Apr 16 22:18:58 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:18:58 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc" returned: 0 in 0.786s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb3efcc-5cda-4a70-8c02-58d7df85d198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d59145-2091-4389-aa73-5d7dd55d18dc', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c07f223-95c9-452b-b815-c9fd316ea89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:18:58 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Volume volume-f4d59145-2091-4389-aa73-5d7dd55d18dc (f4d59145-2091-4389-aa73-5d7dd55d18dc): created successfully Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c07f223-95c9-452b-b815-c9fd316ea89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:18:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (569bf091-a48c-4c82-9edf-ae10b11ce450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:18:58 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a292edac-ccdc-441b-869f-1f325b329ad6 tempest-VolumesActionsTest-1459154100 None] Created volume successfully. Apr 16 22:19:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-f4d59145-2091-4389-aa73-5d7dd55d18dc-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Lock "cinder-f4d59145-2091-4389-aa73-5d7dd55d18dc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-quobyte-f4d59145-2091-4389-aa73-5d7dd55d18dc" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Lock "cinder-quobyte-f4d59145-2091-4389-aa73-5d7dd55d18dc" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:00 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[61476b3b-ca69-4396-98dd-501254155ec9]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:00 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc Apr 16 22:19:00 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:01 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc" returned: 0 in 0.889s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:01 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc Apr 16 22:19:01 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:01 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f4d59145-2091-4389-aa73-5d7dd55d18dc" returned: 0 in 0.653s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Lock "cinder-quobyte-f4d59145-2091-4389-aa73-5d7dd55d18dc" released by "delete_volume" :: held 1.596s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:01 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Created reservations ['2b526c27-45ff-4b34-b86b-603e566eae37', 'e7a32243-9e41-42b9-9494-4979b62b0fce', '72991d08-f221-42ae-8595-8da5d822f3f2', 'c0ba5b7a-2981-4c66-abf2-eabf69f647ab'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:02 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:02 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:02 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.623s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Deleted volume successfully. Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f3578ddb-9940-47a4-bc52-4d38a704e13d tempest-VolumesActionsTest-2135731517 None] Lock "cinder-f4d59145-2091-4389-aa73-5d7dd55d18dc-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (08a0c65f-11d6-4414-aed1-b44919d0e971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3515abc7-88cd-42ce-a940-5ba35ea69dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3515abc7-88cd-42ce-a940-5ba35ea69dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1315104251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93234a46-46c9-4a94-9e34-3ceaddd8c44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:03Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0ff49e-07aa-4b8c-9ea6-09f364524d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0ff49e-07aa-4b8c-9ea6-09f364524d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63361fa1-7b92-4da9-9d48-b22de767d2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63361fa1-7b92-4da9-9d48-b22de767d2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93234a46-46c9-4a94-9e34-3ceaddd8c44a', 'volume_name': 'volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7967896-7e28-4a7f-935b-d4ac88363b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7967896-7e28-4a7f-935b-d4ac88363b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bf221c-91f1-4d41-8eee-29de687e606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:02 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Volume 93234a46-46c9-4a94-9e34-3ceaddd8c44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a', 'volume_size': 1} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1315104251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93234a46-46c9-4a94-9e34-3ceaddd8c44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:03Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Creating volume 93234a46-46c9-4a94-9e34-3ceaddd8c44a {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:19:03 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:19:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:03 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a 1073741824 Apr 16 22:19:03 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:04 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a 1073741824" returned: 0 in 1.050s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:04 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a Apr 16 22:19:04 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:04 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a" returned: 0 in 0.779s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bf221c-91f1-4d41-8eee-29de687e606a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ee1679-ff74-42d4-bfd1-8a0d59aaf44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:04 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Volume volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a (93234a46-46c9-4a94-9e34-3ceaddd8c44a): created successfully Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ee1679-ff74-42d4-bfd1-8a0d59aaf44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (08a0c65f-11d6-4414-aed1-b44919d0e971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:04 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-fcbc66a4-b3bd-430c-8e31-d0dcb5c4ab78 tempest-VolumesActionsTest-1459154100 None] Created volume successfully. Apr 16 22:19:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-93234a46-46c9-4a94-9e34-3ceaddd8c44a-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Lock "cinder-93234a46-46c9-4a94-9e34-3ceaddd8c44a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-quobyte-93234a46-46c9-4a94-9e34-3ceaddd8c44a" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Lock "cinder-quobyte-93234a46-46c9-4a94-9e34-3ceaddd8c44a" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:05 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[779234d0-80c1-4e0e-9866-ff7525a386f7]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:05 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a Apr 16 22:19:05 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:06 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a" returned: 0 in 0.841s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:06 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a Apr 16 22:19:06 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-fc5aa9e3-4d8e-4cb0-b674-e89f0c7ecd2c tempest-VolumesActionsTest-199560265 None] Acquiring lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d" by "attach_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-fc5aa9e3-4d8e-4cb0-b674-e89f0c7ecd2c tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d" acquired by "attach_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:06 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-fc5aa9e3-4d8e-4cb0-b674-e89f0c7ecd2c tempest-VolumesActionsTest-199560265 None] Attaching volume febf259e-2b04-4721-9dd9-fb28ae26f66d to instance e2d6a340-ac09-4a3b-8c45-7c32e3c31c91 at mountpoint /dev/vdb on host None. Apr 16 22:19:06 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-fc5aa9e3-4d8e-4cb0-b674-e89f0c7ecd2c tempest-VolumesActionsTest-199560265 None] Attach volume completed successfully. Apr 16 22:19:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-fc5aa9e3-4d8e-4cb0-b674-e89f0c7ecd2c tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d" released by "attach_volume" :: held 0.142s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:07 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-93234a46-46c9-4a94-9e34-3ceaddd8c44a" returned: 0 in 0.680s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Lock "cinder-quobyte-93234a46-46c9-4a94-9e34-3ceaddd8c44a" released by "delete_volume" :: held 1.570s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Created reservations ['ab28725c-5939-4329-aabb-d1f2fac2f1be', 'a357d609-88c6-431e-81fa-325c68cf3325', '54c8254a-2d17-4386-af99-15875762550e', 'ad9adb3b-1b6b-45b8-a12e-dbea48e2c00b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:07 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:07 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a7da0812-3eb8-4a1b-a913-9452967d28ef tempest-VolumesActionsTest-199560265 None] Acquiring lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-detach_volume" by "detach_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a7da0812-3eb8-4a1b-a913-9452967d28ef tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:07 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a7da0812-3eb8-4a1b-a913-9452967d28ef tempest-VolumesActionsTest-199560265 None] Detaching volume febf259e-2b04-4721-9dd9-fb28ae26f66d from instance e2d6a340-ac09-4a3b-8c45-7c32e3c31c91. Apr 16 22:19:07 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a7da0812-3eb8-4a1b-a913-9452967d28ef tempest-VolumesActionsTest-199560265 None] Detach volume completed successfully. Apr 16 22:19:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a7da0812-3eb8-4a1b-a913-9452967d28ef tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:08 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.660s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Deleted volume successfully. Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c3cd2ccd-cf4e-4989-af7e-67175c376603 tempest-VolumesActionsTest-2135731517 None] Lock "cinder-93234a46-46c9-4a94-9e34-3ceaddd8c44a-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Flow 'volume_create_manager' (ce5fdd0b-23a1-4ab2-a381-d69192a6857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ac3726-574e-415d-b176-4f3c67fb5c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ac3726-574e-415d-b176-4f3c67fb5c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-684933068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df17a7a9-39f2-4d40-b8d5-f3796bc8cece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83a88843ccb4c83aefaaa9b37078bc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:09Z,use_quota=True,user_id='ac6d3a37f8e14d34a744a3805ca48afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ae4950b-3942-4abc-a7d3-6f736ed6e76e),volume_type_id=8ae4950b-3942-4abc-a7d3-6f736ed6e76e)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d590c3-0918-4043-bde1-6caae9fcb727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d590c3-0918-4043-bde1-6caae9fcb727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba48065b-1578-4a5b-af72-e6c62f75d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba48065b-1578-4a5b-af72-e6c62f75d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df17a7a9-39f2-4d40-b8d5-f3796bc8cece', 'volume_name': 'volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5228725d-66b4-4497-993e-70b29b1ecfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5228725d-66b4-4497-993e-70b29b1ecfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13324410-c57a-4862-b9a0-eacc1e2f0d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:08 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Volume df17a7a9-39f2-4d40-b8d5-f3796bc8cece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece', 'volume_size': 1} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-684933068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df17a7a9-39f2-4d40-b8d5-f3796bc8cece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83a88843ccb4c83aefaaa9b37078bc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:09Z,use_quota=True,user_id='ac6d3a37f8e14d34a744a3805ca48afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ae4950b-3942-4abc-a7d3-6f736ed6e76e),volume_type_id=8ae4950b-3942-4abc-a7d3-6f736ed6e76e)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Creating volume df17a7a9-39f2-4d40-b8d5-f3796bc8cece {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:19:08 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:08 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece 1073741824 Apr 16 22:19:08 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (4665c455-a085-43ca-993f-209117ef9a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b93fb3-6b23-4122-a155-b5d919568566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b93fb3-6b23-4122-a155-b5d919568566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1496298669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea214d0-96be-43ac-968d-6a595fb307b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:09Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f5d2d9-ff85-401e-afcc-2c9600b75ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f5d2d9-ff85-401e-afcc-2c9600b75ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1770b4c-b592-4806-99c8-2a8b48d6b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1770b4c-b592-4806-99c8-2a8b48d6b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea214d0-96be-43ac-968d-6a595fb307b4', 'volume_name': 'volume-dea214d0-96be-43ac-968d-6a595fb307b4', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f1a44-469a-4b6d-a595-e2216df469cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f1a44-469a-4b6d-a595-e2216df469cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff88fb20-bb2c-4943-bb56-da3d910a53a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:09 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Volume dea214d0-96be-43ac-968d-6a595fb307b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea214d0-96be-43ac-968d-6a595fb307b4', 'volume_size': 1} Apr 16 22:19:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:09 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece 1073741824" returned: 0 in 0.973s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:09 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece Apr 16 22:19:09 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:10 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece" returned: 0 in 0.726s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1496298669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea214d0-96be-43ac-968d-6a595fb307b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:09Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Creating volume dea214d0-96be-43ac-968d-6a595fb307b4 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:19:10 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13324410-c57a-4862-b9a0-eacc1e2f0d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa88ac3-342a-4d8b-afaa-94d7a5de9a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:10 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 1073741824 Apr 16 22:19:10 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:10 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Volume volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece (df17a7a9-39f2-4d40-b8d5-f3796bc8cece): created successfully Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa88ac3-342a-4d8b-afaa-94d7a5de9a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Flow 'volume_create_manager' (ce5fdd0b-23a1-4ab2-a381-d69192a6857b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:10 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d425e2e5-53d8-45c4-99ac-be7b3a69f800 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Created volume successfully. Apr 16 22:19:11 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 1073741824" returned: 0 in 0.902s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:11 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 Apr 16 22:19:11 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:12 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4" returned: 0 in 0.626s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff88fb20-bb2c-4943-bb56-da3d910a53a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea214d0-96be-43ac-968d-6a595fb307b4', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b23e373-fa35-4b18-b160-f49dbe964f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:12 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Volume volume-dea214d0-96be-43ac-968d-6a595fb307b4 (dea214d0-96be-43ac-968d-6a595fb307b4): created successfully Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b23e373-fa35-4b18-b160-f49dbe964f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (4665c455-a085-43ca-993f-209117ef9a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:12 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-eb2deb5c-0548-4b45-bcaa-233dbf7fd170 tempest-VolumesActionsTest-1459154100 None] Created volume successfully. Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Flow 'volume_create_manager' (8a557e0d-b442-48a7-9418-74159c3c1c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5dc256-bb9a-4ba7-8329-5212126b4d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5dc256-bb9a-4ba7-8329-5212126b4d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-449681435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa51417928b34b3490f24163714aad66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:12Z,use_quota=True,user_id='e521929cb29c4ee2b84a98320631983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1717d6-89f3-4cea-975e-340779fc8960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1717d6-89f3-4cea-975e-340779fc8960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e23374-2992-438c-aa96-f5800aedb896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e23374-2992-438c-aa96-f5800aedb896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9', 'volume_name': 'volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddd88f1-a1d9-47ff-a6eb-d92d1a7bf576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddd88f1-a1d9-47ff-a6eb-d92d1a7bf576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a863a0-6d61-4ffa-bac1-4cc3ce15110f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:12 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Volume 0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9', 'volume_size': 1} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-449681435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa51417928b34b3490f24163714aad66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:12Z,use_quota=True,user_id='e521929cb29c4ee2b84a98320631983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Creating volume 0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:19:12 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:12 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 1073741824 Apr 16 22:19:12 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:12 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:12 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-dea214d0-96be-43ac-968d-6a595fb307b4-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Lock "cinder-dea214d0-96be-43ac-968d-6a595fb307b4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:13 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-quobyte-dea214d0-96be-43ac-968d-6a595fb307b4" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.662s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:13 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-493863d0-5e36-412e-a756-21064166952b tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Retype volume completed successfully. Apr 16 22:19:13 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Lock "cinder-quobyte-dea214d0-96be-43ac-968d-6a595fb307b4" acquired by "delete_volume" :: waited 0.029s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 1073741824" returned: 0 in 0.815s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1134e19-4009-48f2-971a-d05da6f0cac8]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:13 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 Apr 16 22:19:13 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:13 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 Apr 16 22:19:13 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Acquiring lock "cinder-df17a7a9-39f2-4d40-b8d5-f3796bc8cece-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "cinder-df17a7a9-39f2-4d40-b8d5-f3796bc8cece-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Acquiring lock "cinder-quobyte-df17a7a9-39f2-4d40-b8d5-f3796bc8cece" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "cinder-quobyte-df17a7a9-39f2-4d40-b8d5-f3796bc8cece" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a07cb3c-f9a8-44fd-9030-aa9247b28b84]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:14 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece Apr 16 22:19:14 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:14 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" returned: 0 in 0.749s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a863a0-6d61-4ffa-bac1-4cc3ce15110f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2b5226-e8e4-4968-ae68-13d597a9632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:14 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Volume volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 (0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9): created successfully Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2b5226-e8e4-4968-ae68-13d597a9632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Flow 'volume_create_manager' (8a557e0d-b442-48a7-9418-74159c3c1c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:14 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-73097d3c-b2bf-4e2d-b776-34f1c2f2e36b req-8a6992c9-616d-4426-8853-d2b10d9f3441 tempest-VolumesSnapshotsTestJSON-1592292464 None] Created volume successfully. Apr 16 22:19:14 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4" returned: 0 in 0.901s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:14 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4 Apr 16 22:19:14 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:14 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece" returned: 0 in 0.739s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:14 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece Apr 16 22:19:14 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:14 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dea214d0-96be-43ac-968d-6a595fb307b4" returned: 0 in 0.700s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Creating offline snapshot 09002ec4-73ed-416a-a912-a64078a3c4b3 of volume 0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Lock "cinder-quobyte-dea214d0-96be-43ac-968d-6a595fb307b4" released by "delete_volume" :: held 1.667s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[37214a03-6f22-4b8d-aee4-266516fda10f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Created reservations ['1385bff2-c6ad-41d5-94f4-1946756aa3de', 'd5cbb613-8360-4f0d-ad7b-608613132d47', '6b6cda65-7d91-41e1-8609-8306d95c94e9', '34b0745b-9fb6-4883-885a-4069259f9fc8'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:15 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 Apr 16 22:19:15 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:15 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:15 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:15 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-df17a7a9-39f2-4d40-b8d5-f3796bc8cece" returned: 0 in 0.767s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "cinder-quobyte-df17a7a9-39f2-4d40-b8d5-f3796bc8cece" released by "delete_volume" :: held 1.551s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:15 devstack cinder-volume[82650]: WARNING cinder.quota [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:19:15 devstack cinder-volume[82650]: WARNING cinder.quota [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Created reservations ['c855dde6-d0ef-49f3-8f1e-73e5d9740851', '3ef3000f-3bb2-4edc-9e54-ca4477675799', 'e9066e26-7fc1-44a0-a9b8-43526cae2801', 'f0159197-d84c-4d54-ab0f-8c77f70a45b4'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:15 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:15 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:16 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:16 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.902s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" returned: 0 in 1.082s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:16 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Deleted volume successfully. Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8613511a-dc21-40bc-8391-5722bd9d523b tempest-VolumesActionsTest-2135731517 None] Lock "cinder-dea214d0-96be-43ac-968d-6a595fb307b4-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:16 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:16 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 1G Apr 16 22:19:16 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.543s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:16 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Deleted volume successfully. Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c04f934-dc47-4840-8822-262362bc73b6 tempest-VolumeRetypeWithoutMigrationTest-1578034623 None] Lock "cinder-df17a7a9-39f2-4d40-b8d5-f3796bc8cece-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (503fd71c-a77f-4355-ba00-e29af35071c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150c5843-d75b-4f94-800c-482bc84cd1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150c5843-d75b-4f94-800c-482bc84cd1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2045448586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175fc52a-b4be-4137-8a5b-391a61bd56b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:16Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fc564d-6206-4846-84fc-9c73b7f77abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fc564d-6206-4846-84fc-9c73b7f77abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123c32e8-a33f-4bf0-9bb2-9f4f2dd4f5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123c32e8-a33f-4bf0-9bb2-9f4f2dd4f5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175fc52a-b4be-4137-8a5b-391a61bd56b7', 'volume_name': 'volume-175fc52a-b4be-4137-8a5b-391a61bd56b7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa9d3b2-6d70-440a-a338-7c17576af487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa9d3b2-6d70-440a-a338-7c17576af487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed3be3c-6d08-4e48-81ef-5121a0b8a540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:16 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Volume 175fc52a-b4be-4137-8a5b-391a61bd56b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175fc52a-b4be-4137-8a5b-391a61bd56b7', 'volume_size': 1} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:16 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 1G" returned: 0 in 0.726s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:16 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 Apr 16 22:19:16 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:17 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3" returned: 0 in 0.737s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:17 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 is being set with open permissions: ugo+rw Apr 16 22:19:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:17 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 Apr 16 22:19:17 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:18 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3" returned: 0 in 0.490s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:18 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.info Apr 16 22:19:18 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:18 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.info" returned: 0 in 0.509s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:18 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.info is being set with open permissions: ugo+rw Apr 16 22:19:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:18 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.info Apr 16 22:19:18 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:19 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.info" returned: 0 in 0.495s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.157s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2045448586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175fc52a-b4be-4137-8a5b-391a61bd56b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:16Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Creating volume 175fc52a-b4be-4137-8a5b-391a61bd56b7 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:19:19 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:19 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 1073741824 Apr 16 22:19:19 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-63c9cb72-11ed-4ec2-9432-341750761c49 req-47064a0c-7c6d-4791-bbb4-45978fea329e tempest-VolumesSnapshotsTestJSON-1592292464 None] Create snapshot completed successfully Apr 16 22:19:19 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "cinder-09002ec4-73ed-416a-a912-a64078a3c4b3-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-09002ec4-73ed-416a-a912-a64078a3c4b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "cinder-quobyte-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-quobyte-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "cinder-quobyte-09002ec4-73ed-416a-a912-a64078a3c4b3" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-quobyte-09002ec4-73ed-416a-a912-a64078a3c4b3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Deleting offline snapshot 09002ec4-73ed-416a-a912-a64078a3c4b3 of volume 0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] snapshot_file for this snap is: volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b4540-353d-4ae0-8daa-9bbeb04b2e7d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:19 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 Apr 16 22:19:19 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:19 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 1073741824" returned: 0 in 0.815s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:20 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 Apr 16 22:19:20 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:20 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3" returned: 0 in 0.941s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928792e-f298-4158-b453-25e1f3af4461]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:20 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7" returned: 0 in 0.656s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.016s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed3be3c-6d08-4e48-81ef-5121a0b8a540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175fc52a-b4be-4137-8a5b-391a61bd56b7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e53992d-edce-494c-91b4-5ed1adeb43ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b910a0c9-dc30-4dc8-9735-35a03687ae85]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:20 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Volume volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 (175fc52a-b4be-4137-8a5b-391a61bd56b7): created successfully Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e53992d-edce-494c-91b4-5ed1adeb43ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (503fd71c-a77f-4355-ba00-e29af35071c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:20 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-996f5661-8096-465f-b453-a02aa966ca08 tempest-VolumesActionsTest-1459154100 None] Created volume successfully. Apr 16 22:19:20 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 Apr 16 22:19:20 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:20 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:19:20 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:21 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.646s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2441854e-5b6d-4b2b-a617-a8672f0e869b]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:21 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" returned: 0 in 0.820s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:21 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 Apr 16 22:19:21 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:21 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:19:21 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-175fc52a-b4be-4137-8a5b-391a61bd56b7-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Lock "cinder-175fc52a-b4be-4137-8a5b-391a61bd56b7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Acquiring lock "cinder-quobyte-175fc52a-b4be-4137-8a5b-391a61bd56b7" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Lock "cinder-quobyte-175fc52a-b4be-4137-8a5b-391a61bd56b7" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d4f0bf-be9c-4a7b-b665-626975fa09a4]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:21 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 Apr 16 22:19:21 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:22 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.696s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.1cd6e3b1-1f31-4212-a7e4-47e011e4ede2oqc2d_87.img {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:22 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.1cd6e3b1-1f31-4212-a7e4-47e011e4ede2oqc2d_87.img Apr 16 22:19:22 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:22 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3" returned: 0 in 0.662s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:22 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3 Apr 16 22:19:22 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:22 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7" returned: 0 in 0.729s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:22 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7 Apr 16 22:19:22 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:22 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9.09002ec4-73ed-416a-a912-a64078a3c4b3" returned: 0 in 0.604s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=122,cinder:UPDATE=136,cinder:INSERT=37,cinder:DELETE=12 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=126,cinder:UPDATE=144,cinder:INSERT=27,cinder:DELETE=6 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-quobyte-09002ec4-73ed-416a-a912-a64078a3c4b3" released by "_delete_snapshot" :: held 3.197s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-quobyte-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" released by "delete_snapshot" :: held 3.280s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:23 devstack cinder-volume[82650]: DEBUG cinder.quota [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Created reservations ['69024d59-9d6a-43ad-b725-047a2df597bc', '0eae3467-914b-4f0b-8874-69243d60aaf8', 'e7eaebf3-c5d5-4985-91f4-947cd5cc6313', '69dc8722-5f1d-4dee-ac06-b9646611da64'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Delete snapshot completed successfully. Apr 16 22:19:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-16492ce6-d946-4886-a79e-da02bd1dd5d9 req-eb472414-8d61-48d3-b318-28fb1cb0f2b8 tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-09002ec4-73ed-416a-a912-a64078a3c4b3-delete_snapshot" released by "delete_snapshot" :: held 3.891s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "cinder-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:24 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-175fc52a-b4be-4137-8a5b-391a61bd56b7" returned: 0 in 1.886s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Lock "cinder-quobyte-175fc52a-b4be-4137-8a5b-391a61bd56b7" released by "delete_volume" :: held 2.697s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "cinder-quobyte-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:24 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:24 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-quobyte-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" acquired by "delete_volume" :: waited 0.050s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d322ce-a858-4195-861d-ee7fdca3c5cd]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:24 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Created reservations ['ed58efa9-a0e7-4422-b54b-731b1d502f65', '4e52003a-51f4-41ad-bfb2-9aa1054c3b5f', '922a26f3-ff7f-4b05-809b-a1c960decbdd', '7c8c24b9-512d-40f7-8a2f-f1bfaaa4bd4a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:25 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 Apr 16 22:19:25 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:25 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:25 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:25 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.1cd6e3b1-1f31-4212-a7e4-47e011e4ede2oqc2d_87.img" returned: 0 in 3.119s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f1a52e-3581-434a-9798-66a5daf0afd5]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:25 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:19:25 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:25 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.087s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:19:25 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:25 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" returned: 0 in 1.097s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.766s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:25 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Deleted volume successfully. Apr 16 22:19:25 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9 Apr 16 22:19:25 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-003b33fa-8e76-4ca3-8d7e-d8a8d7918adf tempest-VolumesActionsTest-2135731517 None] Lock "cinder-175fc52a-b4be-4137-8a5b-391a61bd56b7-delete_volume" released by "delete_volume" :: held 4.258s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:26 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.916s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d, size 1024.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.1cd6e3b1-1f31-4212-a7e4-47e011e4ede2oqc2d_87.img {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:19:26 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Converted 1024.00 MB image at 328.14 MB/s Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] 1cd6e3b1-1f31-4212-a7e4-47e011e4ede2 was raw, no need to convert to raw {{(pid=82650) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:26 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (cf64b168-3237-4b29-9e4d-189235c7e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9bdce1-2310-484f-83f9-499b22651a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" returned: 0 in 0.822s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9bdce1-2310-484f-83f9-499b22651a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309488534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6162610-0c48-4fea-a853-21f31689935f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:27Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17520c11-9f7b-4c85-af00-0b3c5da1106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17520c11-9f7b-4c85-af00-0b3c5da1106e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae6ee2a-46fa-4512-a6e7-27c0fc087953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae6ee2a-46fa-4512-a6e7-27c0fc087953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6162610-0c48-4fea-a853-21f31689935f', 'volume_name': 'volume-b6162610-0c48-4fea-a853-21f31689935f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36774a4-6993-4115-be01-384bcd7f4c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36774a4-6993-4115-be01-384bcd7f4c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b027702c-3856-4ac9-a73e-72f93a542a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:26 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Volume b6162610-0c48-4fea-a853-21f31689935f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6162610-0c48-4fea-a853-21f31689935f', 'volume_size': 1} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-quobyte-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9" released by "delete_volume" :: held 2.123s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.quota [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Created reservations ['45918de0-4b13-4fca-a6a6-568facb074e5', '1d5edf46-3a98-494e-a98f-c67deed3814e', '1bddbb27-3385-4430-a525-20f2d45bc767', '7a3fb0e1-9957-43ca-b5de-6308ae4dcb6f'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:26 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:26 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Flow 'volume_create_manager' (d2170cfc-a6ff-44e9-90ec-8b9aad81d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c46512-587d-40c1-8b96-53f9ac50bdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c46512-587d-40c1-8b96-53f9ac50bdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-291310399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9eca65c-63fc-483c-997c-151aa6a89abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc6ebfcee6f473d9c38df7504a39e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:27Z,use_quota=True,user_id='00a896d769ec4ce1a2048d7d5de798ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8402e37-11e1-47c6-a6dd-c85bc48c42cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8402e37-11e1-47c6-a6dd-c85bc48c42cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7536721f-7cba-4c7c-859f-c44a8c703d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:26 devstack cinder-volume[82650]: DEBUG cinder.image.glance [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Creating Keystone auth plugin from conf {{(pid=82650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7536721f-7cba-4c7c-859f-c44a8c703d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9eca65c-63fc-483c-997c-151aa6a89abb', 'volume_name': 'volume-d9eca65c-63fc-483c-997c-151aa6a89abb', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404c4c99-7fc1-4944-8ff2-46fffb38a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404c4c99-7fc1-4944-8ff2-46fffb38a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bc4875-bb6e-431a-8a09-eadb7736da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:27 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Volume d9eca65c-63fc-483c-997c-151aa6a89abb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9eca65c-63fc-483c-997c-151aa6a89abb', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Trying to clone d9eca65c-63fc-483c-997c-151aa6a89abb from image fc1a3fa2-bedc-4143-856a-42ade81658d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]). {{(pid=82650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 22:19:27 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.540s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG cinder.manager [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Deleted volume successfully. Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 22:19:27 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Image download 20.69 MB at 20.69 MB/s Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [req-87e244aa-e52d-4b82-a459-a6ec454a7c43 req-2779c425-60a2-4aa8-855b-6c95da77bafb tempest-VolumesSnapshotsTestJSON-1592292464 None] Lock "cinder-0b5d32c9-56d7-4a85-82ac-4b7be70dfdb9-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[77113c5f-f5bf-4796-b8fb-84b4cf07bab1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:27 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD Apr 16 22:19:27 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:28 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:28 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Temporary image fc1a3fa2-bedc-4143-856a-42ade81658d5 is fetched for user 00a896d769ec4ce1a2048d7d5de798ee. {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 22:19:28 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a85d46-1877-4b98-b279-9da0acebb0c1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:28 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD Apr 16 22:19:28 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:29 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-56992b1b-dd46-4f87-bc38-0122d043ef79 tempest-GroupSnapshotsV319Test-131685574 None] Group tempest-GroupSnapshotsV319Test-Group-261830429: creating Apr 16 22:19:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-56992b1b-dd46-4f87-bc38-0122d043ef79 tempest-GroupSnapshotsV319Test-131685574 None] Group tempest-GroupSnapshotsV319Test-Group-261830429: created successfully Apr 16 22:19:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-56992b1b-dd46-4f87-bc38-0122d043ef79 tempest-GroupSnapshotsV319Test-131685574 None] Create group completed successfully. Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Flow 'volume_create_manager' (5ae9023b-c37c-476f-a0c2-7a989446e77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ef5f4a-7d11-4e29-acf0-2b3f99d4c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ef5f4a-7d11-4e29-acf0-2b3f99d4c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1898275173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48b31229-6699-4485-84b0-09274fbafde3,host='devstack@QuobyteHD#QuobyteHD',id=eb6011f7-c738-4dd1-a2f9-c177f5705b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e78da3244c354a2c9b5eaf34fe5273c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:39Z,use_quota=True,user_id='1e36ec2fbbfd46e7a680054941cfae32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(202c8ac3-ba4b-42e2-a512-cabb7b352d96),volume_type_id=202c8ac3-ba4b-42e2-a512-cabb7b352d96)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ebb5e9-c289-46f0-96a8-a38689500da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ebb5e9-c289-46f0-96a8-a38689500da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684df556-e435-402f-9fe7-a975a1a5f877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684df556-e435-402f-9fe7-a975a1a5f877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6011f7-c738-4dd1-a2f9-c177f5705b78', 'volume_name': 'volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6614ecbb-4b1b-444b-b593-239676faade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6614ecbb-4b1b-444b-b593-239676faade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaa485c-d995-4eb4-be49-09bef68c8cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:38 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Volume eb6011f7-c738-4dd1-a2f9-c177f5705b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78', 'volume_size': 1} Apr 16 22:19:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 18.527s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Uploaded volume to glance image-id: 1cd6e3b1-1f31-4212-a7e4-47e011e4ede2. {{(pid=82650) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.484s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309488534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6162610-0c48-4fea-a853-21f31689935f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3343bb84c5a048dd82712de193181cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:27Z,use_quota=True,user_id='0bd8e12695e643afaa19bf1e65ea21bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Creating volume b6162610-0c48-4fea-a853-21f31689935f {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:19:39 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:39 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f 1073741824 Apr 16 22:19:39 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:39 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-52b38ac3-24d3-49e9-96e5-e09aea90feb4 tempest-VolumesActionsTest-199560265 None] Copy volume to image completed successfully. Apr 16 22:19:39 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f 1073741824" returned: 0 in 0.779s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:40 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f Apr 16 22:19:40 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:40 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f" returned: 0 in 0.618s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.424s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-291310399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9eca65c-63fc-483c-997c-151aa6a89abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc6ebfcee6f473d9c38df7504a39e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:27Z,use_quota=True,user_id='00a896d769ec4ce1a2048d7d5de798ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Creating volume d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:19:40 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b027702c-3856-4ac9-a73e-72f93a542a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6162610-0c48-4fea-a853-21f31689935f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85f324d-9f3c-487f-90a5-96e21c0cb69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:40 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb 1073741824 Apr 16 22:19:40 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:40 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Volume volume-b6162610-0c48-4fea-a853-21f31689935f (b6162610-0c48-4fea-a853-21f31689935f): created successfully Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85f324d-9f3c-487f-90a5-96e21c0cb69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Flow 'volume_create_manager' (cf64b168-3237-4b29-9e4d-189235c7e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:40 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-91267008-c608-453b-841e-9434c365c0dc tempest-VolumesActionsTest-1459154100 None] Created volume successfully. Apr 16 22:19:41 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb 1073741824" returned: 0 in 0.635s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:41 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb Apr 16 22:19:41 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:41 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb" returned: 0 in 0.543s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.210s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=48b31229-6699-4485-84b0-09274fbafde3,created_at=2026-04-16T20:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1898275173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48b31229-6699-4485-84b0-09274fbafde3,host='devstack@QuobyteHD#QuobyteHD',id=eb6011f7-c738-4dd1-a2f9-c177f5705b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e78da3244c354a2c9b5eaf34fe5273c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:19:39Z,use_quota=True,user_id='1e36ec2fbbfd46e7a680054941cfae32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(202c8ac3-ba4b-42e2-a512-cabb7b352d96),volume_type_id=202c8ac3-ba4b-42e2-a512-cabb7b352d96)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Creating volume eb6011f7-c738-4dd1-a2f9-c177f5705b78 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:19:41 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Attempting download of fc1a3fa2-bedc-4143-856a-42ade81658d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}])) to volume d9eca65c-63fc-483c-997c-151aa6a89abb. {{(pid=82650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 16 22:19:41 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 1073741824 Apr 16 22:19:41 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2786533c-dace-4697-bb87-ce458e538583]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_veikgqas {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:42 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_veikgqas Apr 16 22:19:42 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "cinder-b6162610-0c48-4fea-a853-21f31689935f-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-b6162610-0c48-4fea-a853-21f31689935f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "cinder-quobyte-b6162610-0c48-4fea-a853-21f31689935f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-quobyte-b6162610-0c48-4fea-a853-21f31689935f" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[71df45f3-3993-4a5f-bee3-77bad90ad089]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:42 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f Apr 16 22:19:42 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:42 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 1073741824" returned: 0 in 0.756s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:42 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_veikgqas" returned: 0 in 0.696s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_veikgqas {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:42 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 Apr 16 22:19:42 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:42 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_veikgqas Apr 16 22:19:42 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:43 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f" returned: 0 in 0.755s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:43 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f Apr 16 22:19:43 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:43 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78" returned: 0 in 0.607s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.766s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaa485c-d995-4eb4-be49-09bef68c8cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b280cf4e-83ee-401a-8f72-add99296fd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[918cc1b0-f0ae-4797-bedd-055da5e43997]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:43 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Volume volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 (eb6011f7-c738-4dd1-a2f9-c177f5705b78): created successfully Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b280cf4e-83ee-401a-8f72-add99296fd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Flow 'volume_create_manager' (5ae9023b-c37c-476f-a0c2-7a989446e77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:43 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e90c3b3c-7609-44db-8cd8-04139e72d41f tempest-GroupSnapshotsV319Test-131685574 None] Created volume successfully. Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_veikgqas" returned: 1 in 0.734s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_veikgqas' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0c9ad6-ddfd-400b-ac21-4e5d5ecf2c29]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:43 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:19:43 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:43 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD Apr 16 22:19:43 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:43 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b6162610-0c48-4fea-a853-21f31689935f" returned: 0 in 0.650s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-quobyte-b6162610-0c48-4fea-a853-21f31689935f" released by "delete_volume" :: held 1.441s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Created reservations ['cea51b14-2381-4511-9c34-14a7a3b0e54e', 'ccc9640e-c95f-4cb1-b1cb-03f2dbf546e0', '476a9575-d985-4a34-8ccd-797cf2fbfe6f', 'c76556ee-cb8d-4936-badf-f6721d1c41fd'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:44 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.706s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6a2a0e-0d7e-4206-9238-0cdac8183195]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:44 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] fc1a3fa2-bedc-4143-856a-42ade81658d5 was qcow2, converting to raw {{(pid=82650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 22:19:44 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:44 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:44 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:19:44 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:44 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb Apr 16 22:19:44 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:44 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] GroupSnapshot 7e706ab1-fe1a-42d6-af34-2757739d8b17: creating. Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Group snapshot 7e706ab1-fe1a-42d6-af34-2757739d8b17: creating. {{(pid=82650) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:44 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.764s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:44 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.721s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:44 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img Apr 16 22:19:44 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:44 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Deleted volume successfully. Apr 16 22:19:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-db26dfaf-cc7e-466b-94dd-ade71de2ef87 tempest-VolumesActionsTest-1459154100 None] Lock "cinder-b6162610-0c48-4fea-a853-21f31689935f-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:45 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb" returned: 0 in 1.748s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:45 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_n4e2nhzudevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:19:45 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Converted 112.00 MB image at 63.97 MB/s Apr 16 22:19:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:46 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb 1G Apr 16 22:19:46 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:48 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb 1G" returned: 0 in 2.357s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:48 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57b77b8-0bed-4f47-9408-64ca3c9702e9]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:48 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img" returned: 0 in 3.526s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:48 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2707c6f6-4651-4098-996d-f0cb35f94ec0]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:48 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb Apr 16 22:19:48 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:48 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:19:48 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:48 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb" returned: 0 in 0.657s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:49 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb Apr 16 22:19:49 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:49 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.861s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d, size 1024.00 MB, duration 3.53 sec, destination /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:19:49 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Converted 1024.00 MB image at 290.23 MB/s Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] 318d0f86-32c5-423f-9200-81663236d593 was raw, converting to qcow2 {{(pid=82650) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d5c8ba-1748-4706-ac94-25f2b945bae9]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:49 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img Apr 16 22:19:49 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:49 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb" returned: 1 in 0.669s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Downloaded image fc1a3fa2-bedc-4143-856a-42ade81658d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}])) to volume d9eca65c-63fc-483c-997c-151aa6a89abb successfully. {{(pid=82650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Temporary image fc1a3fa2-bedc-4143-856a-42ade81658d5 for user 00a896d769ec4ce1a2048d7d5de798ee is deleted. {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Marking volume d9eca65c-63fc-483c-997c-151aa6a89abb as bootable. {{(pid=82650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Copying metadata from image fc1a3fa2-bedc-4143-856a-42ade81658d5 to d9eca65c-63fc-483c-997c-151aa6a89abb. {{(pid=82650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Creating volume glance metadata for volume d9eca65c-63fc-483c-997c-151aa6a89abb backed by image fc1a3fa2-bedc-4143-856a-42ade81658d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bc4875-bb6e-431a-8a09-eadb7736da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9eca65c-63fc-483c-997c-151aa6a89abb', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5ac654-5146-4055-86ca-b7fdb9b56867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:49 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Volume volume-d9eca65c-63fc-483c-997c-151aa6a89abb (d9eca65c-63fc-483c-997c-151aa6a89abb): created successfully Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5ac654-5146-4055-86ca-b7fdb9b56867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Flow 'volume_create_manager' (d2170cfc-a6ff-44e9-90ec-8b9aad81d19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-0953f16f-df3a-4e8e-b00f-0326c51ccf20 tempest-VolumesImageMetadata-928725405 None] Created volume successfully. Apr 16 22:19:49 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img" returned: 0 in 0.704s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:50 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img Apr 16 22:19:50 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:50 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img" returned: 1 in 0.627s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:19:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img /opt/stack/data/cinder/conversion/vol_upload__y3gspc7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:50 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img /opt/stack/data/cinder/conversion/vol_upload__y3gspc7 Apr 16 22:19:50 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:51 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img /opt/stack/data/cinder/conversion/vol_upload__y3gspc7" returned: 0 in 0.594s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Image conversion details: src /opt/stack/data/cinder/conversion/febf259e-2b04-4721-9dd9-fb28ae26f66d.temp_image.318d0f86-32c5-423f-9200-81663236d593drdxky1z.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__y3gspc7 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:19:51 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b51031-9d35-417b-b471-86d3c17168d7]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__y3gspc7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Acquiring lock "cinder-d9eca65c-63fc-483c-997c-151aa6a89abb-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Lock "cinder-d9eca65c-63fc-483c-997c-151aa6a89abb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Acquiring lock "cinder-quobyte-d9eca65c-63fc-483c-997c-151aa6a89abb" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Lock "cinder-quobyte-d9eca65c-63fc-483c-997c-151aa6a89abb" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:51 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__y3gspc7 Apr 16 22:19:51 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed340c0f-1230-4774-ba80-7d6403519b56]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:51 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb Apr 16 22:19:51 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:51 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__y3gspc7" returned: 0 in 0.630s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:52 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb" returned: 0 in 0.708s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:52 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb Apr 16 22:19:52 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:52 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb" returned: 1 in 0.780s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:19:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:52 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb Apr 16 22:19:52 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.815s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Uploaded volume to glance image-id: 318d0f86-32c5-423f-9200-81663236d593. {{(pid=82650) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.760s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:53 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f3b12041-099f-460f-8f31-666ead55061a tempest-VolumesActionsTest-199560265 None] Copy volume to image completed successfully. Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Creating offline snapshot 95f64ec6-044d-4c74-927f-274f9c52205f of volume eb6011f7-c738-4dd1-a2f9-c177f5705b78 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[434f784b-84da-4371-b715-b509cd1edc50]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:53 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 Apr 16 22:19:53 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:53 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d9eca65c-63fc-483c-997c-151aa6a89abb" returned: 0 in 0.703s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Lock "cinder-quobyte-d9eca65c-63fc-483c-997c-151aa6a89abb" released by "delete_volume" :: held 2.246s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Created reservations ['bd319860-1232-4ff5-9f83-530ab49b76b3', '1f419c2b-d8ab-4ee6-8fb2-e9ac340b0844', '07dd57cf-307c-413a-a661-d63adb398322', 'd812fb67-114d-4795-a22f-9135b3c4e569'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:53 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:53 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:53 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78" returned: 0 in 0.746s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:53 devstack sudo[87355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f 1G Apr 16 22:19:53 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:54 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.573s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:54 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Deleted volume successfully. Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bcc4d317-d9a0-48e6-88cd-33a29ac48f98 tempest-VolumesImageMetadata-928725405 None] Lock "cinder-d9eca65c-63fc-483c-997c-151aa6a89abb-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:54 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f 1G" returned: 0 in 0.721s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:54 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f Apr 16 22:19:54 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Acquiring lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Acquiring lock "cinder-quobyte-febf259e-2b04-4721-9dd9-fb28ae26f66d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Lock "cinder-quobyte-febf259e-2b04-4721-9dd9-fb28ae26f66d" acquired by "delete_volume" :: waited 0.007s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[92daaa00-c361-45bd-9ac2-d567c3059ae6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:54 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:19:54 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:55 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f" returned: 0 in 0.780s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:55 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:19:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:55 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f Apr 16 22:19:55 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:55 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.721s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:55 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d Apr 16 22:19:55 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:56 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f" returned: 0 in 0.736s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:56 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.info Apr 16 22:19:56 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:56 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-febf259e-2b04-4721-9dd9-fb28ae26f66d" returned: 0 in 0.963s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Lock "cinder-quobyte-febf259e-2b04-4721-9dd9-fb28ae26f66d" released by "delete_volume" :: held 1.711s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Created reservations ['8c631a9d-a7e5-4008-9a77-00db40f00e4e', 'f4d8d206-8295-45c4-95c1-bd79920b0958', '7b5281ab-4beb-4bb9-b01c-fd11087655b6', '2d3976c7-b72d-4eca-b746-cbe6ee032f59'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:56 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:19:56 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:57 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.info" returned: 0 in 0.954s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:57 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:19:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:57 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.info Apr 16 22:19:57 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:57 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.881s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:57 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:19:57 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Deleted volume successfully. Apr 16 22:19:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-95e072f0-93ae-485d-8f11-c56c10e85cf0 tempest-VolumesActionsTest-199560265 None] Lock "cinder-febf259e-2b04-4721-9dd9-fb28ae26f66d-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:19:57 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.info" returned: 0 in 0.747s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.783s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:19:58 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4aa0970c-3e26-43b6-ac2b-3b5b78b802b5 tempest-GroupSnapshotsV319Test-131685574 None] group_snapshot 7e706ab1-fe1a-42d6-af34-2757739d8b17: created successfully Apr 16 22:19:58 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] group_snapshot 7e706ab1-fe1a-42d6-af34-2757739d8b17: deleting Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] group_snapshot 7e706ab1-fe1a-42d6-af34-2757739d8b17: deleting {{(pid=82650) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Acquiring lock "cinder-quobyte-eb6011f7-c738-4dd1-a2f9-c177f5705b78" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Lock "cinder-quobyte-eb6011f7-c738-4dd1-a2f9-c177f5705b78" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Acquiring lock "cinder-quobyte-95f64ec6-044d-4c74-927f-274f9c52205f" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Lock "cinder-quobyte-95f64ec6-044d-4c74-927f-274f9c52205f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Deleting offline snapshot 95f64ec6-044d-4c74-927f-274f9c52205f of volume eb6011f7-c738-4dd1-a2f9-c177f5705b78 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] snapshot_file for this snap is: volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8a706b-f92f-4bee-8e9d-6c2f6ae0c550]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:58 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f Apr 16 22:19:58 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:19:59 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f" returned: 0 in 1.116s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5762d7c3-b977-4cd3-a994-d5b05f8f552d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Flow 'volume_create_manager' (8df13d62-472f-4381-84c1-64f1f065231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd95fb20-acfa-46e1-a56a-b8eb241aa126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd95fb20-acfa-46e1-a56a-b8eb241aa126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1581488249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff538187-a189-4c7c-b5eb-76e8026722f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924b3cff3aeb46f690c3051cf9745f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:00Z,use_quota=True,user_id='60dcaed95004442d894193408de86d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce13b91e-6e03-41eb-9492-f9a46bb22633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce13b91e-6e03-41eb-9492-f9a46bb22633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:19:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489b88df-a492-4385-b863-c75c51d3689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489b88df-a492-4385-b863-c75c51d3689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff538187-a189-4c7c-b5eb-76e8026722f6', 'volume_name': 'volume-ff538187-a189-4c7c-b5eb-76e8026722f6', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4b5441-a26e-4b62-baec-faca530890a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4b5441-a26e-4b62-baec-faca530890a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc896c3-42cb-46a0-814d-bb16bf2122e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:00 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Volume ff538187-a189-4c7c-b5eb-76e8026722f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff538187-a189-4c7c-b5eb-76e8026722f6', 'volume_size': 1} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1581488249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff538187-a189-4c7c-b5eb-76e8026722f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924b3cff3aeb46f690c3051cf9745f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:00Z,use_quota=True,user_id='60dcaed95004442d894193408de86d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Creating volume ff538187-a189-4c7c-b5eb-76e8026722f6 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:00 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:00 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 Apr 16 22:20:00 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:00 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 1073741824 Apr 16 22:20:00 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Flow 'volume_create_manager' (921f8635-e199-4419-abe4-ade1f78763df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467a04df-4a0b-4ed7-bfa4-0de4a96ce7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467a04df-4a0b-4ed7-bfa4-0de4a96ce7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1035147611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8cd2b1-1dc1-4345-a395-a5d2f7384256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='623111e2c691425a9f4b8958edae3106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:00Z,use_quota=True,user_id='e01aee99c4934aa88ccdc2a069915ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a779ec5-0a8d-4061-81e8-9e08036da493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a779ec5-0a8d-4061-81e8-9e08036da493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7eb542-6b41-4dc2-883c-bf7f9920b0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7eb542-6b41-4dc2-883c-bf7f9920b0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8cd2b1-1dc1-4345-a395-a5d2f7384256', 'volume_name': 'volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aa7ba1-bac6-4e90-8f03-1bcc64ad6df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aa7ba1-bac6-4e90-8f03-1bcc64ad6df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4ba71b-6ff6-4eb3-8685-5a0ed68c1174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:00 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Volume fa8cd2b1-1dc1-4345-a395-a5d2f7384256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256', 'volume_size': 1} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:00 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 1073741824" returned: 0 in 0.748s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:00 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78" returned: 0 in 0.894s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:00 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 Apr 16 22:20:00 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:00 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f Apr 16 22:20:00 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:01 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6" returned: 0 in 0.714s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1035147611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8cd2b1-1dc1-4345-a395-a5d2f7384256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='623111e2c691425a9f4b8958edae3106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:00Z,use_quota=True,user_id='e01aee99c4934aa88ccdc2a069915ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Creating volume fa8cd2b1-1dc1-4345-a395-a5d2f7384256 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:01 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:01 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc896c3-42cb-46a0-814d-bb16bf2122e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff538187-a189-4c7c-b5eb-76e8026722f6', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721a0366-c0eb-40dd-aa3a-04a5ba3e48af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:01 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 1073741824 Apr 16 22:20:01 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f" returned: 0 in 0.771s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:01 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Volume volume-ff538187-a189-4c7c-b5eb-76e8026722f6 (ff538187-a189-4c7c-b5eb-76e8026722f6): created successfully Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721a0366-c0eb-40dd-aa3a-04a5ba3e48af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:01 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Flow 'volume_create_manager' (8df13d62-472f-4381-84c1-64f1f065231f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:01 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f Apr 16 22:20:01 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d25393d5-13f6-4e60-84db-d1c07c2d4f95 tempest-VolumesTransfersV357Test-548349264 None] Created volume successfully. Apr 16 22:20:01 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:02 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78.95f64ec6-044d-4c74-927f-274f9c52205f" returned: 0 in 0.723s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Lock "cinder-quobyte-95f64ec6-044d-4c74-927f-274f9c52205f" released by "_delete_snapshot" :: held 3.616s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:02 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 1073741824" returned: 0 in 0.800s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Lock "cinder-quobyte-eb6011f7-c738-4dd1-a2f9-c177f5705b78" released by "delete_snapshot" :: held 3.641s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:02 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 Apr 16 22:20:02 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:02 devstack cinder-volume[82650]: WARNING cinder.quota [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1344899382 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1344899382, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:20:02 devstack cinder-volume[82650]: WARNING cinder.quota [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1344899382 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1344899382, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:20:02 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] Created reservations ['3ae35b5b-dfcd-4077-b3ca-c2206123cf75', '101441bf-9e44-472d-9d67-8392cf99f5b8', 'b66f7a8c-178a-4f77-bd40-56c295eea116', 'a9515c3c-6b65-451e-b2cb-1148c33d1368'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bd025de7-0c45-4041-a083-a6c34e72a415 tempest-GroupSnapshotsV319Test-131685574 None] group_snapshot 7e706ab1-fe1a-42d6-af34-2757739d8b17: deleted successfully Apr 16 22:20:03 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4a7cf016-ba64-4f39-afa0-d8da79dca66e tempest-VolumesTransfersV357Test-500682198 None] Transfer volume completed successfully. Apr 16 22:20:03 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256" returned: 0 in 0.700s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4ba71b-6ff6-4eb3-8685-5a0ed68c1174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76081351-2581-46c0-9d75-16f3529bf1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:03 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Volume volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 (fa8cd2b1-1dc1-4345-a395-a5d2f7384256): created successfully Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76081351-2581-46c0-9d75-16f3529bf1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Flow 'volume_create_manager' (921f8635-e199-4419-abe4-ade1f78763df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:03 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ef3d4e46-ad72-4a5c-93cb-9f2b2ef71470 tempest-VolumesListAdminTestJSON-1366488192 None] Created volume successfully. Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (7f4272c2-4956-466e-854c-d35f7ff5d51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd222f4-7a11-4bc7-a5ee-6a4143ae5792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd222f4-7a11-4bc7-a5ee-6a4143ae5792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1870175040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5714c82-9895-4c22-b94b-a85664aeb0a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:04Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc3c3ea-59ae-4026-bb6e-a1cdecbe0dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc3c3ea-59ae-4026-bb6e-a1cdecbe0dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd76faef-e57c-4c9c-84e9-66a41022ad27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd76faef-e57c-4c9c-84e9-66a41022ad27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5714c82-9895-4c22-b94b-a85664aeb0a2', 'volume_name': 'volume-e5714c82-9895-4c22-b94b-a85664aeb0a2', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917d21c2-fd55-45c6-9de2-4bd823f734f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917d21c2-fd55-45c6-9de2-4bd823f734f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c7a76a-0935-42d8-ab54-2e847edaf8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:03 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Volume e5714c82-9895-4c22-b94b-a85664aeb0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5714c82-9895-4c22-b94b-a85664aeb0a2', 'volume_size': 1} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1870175040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5714c82-9895-4c22-b94b-a85664aeb0a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:04Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Creating volume e5714c82-9895-4c22-b94b-a85664aeb0a2 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:03 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:03 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 1073741824 Apr 16 22:20:03 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Acquiring lock "cinder-quobyte-eb6011f7-c738-4dd1-a2f9-c177f5705b78" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Lock "cinder-quobyte-eb6011f7-c738-4dd1-a2f9-c177f5705b78" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[822cca31-bebf-4242-be99-22295b480cff]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:04 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 Apr 16 22:20:04 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Acquiring lock "cinder-ff538187-a189-4c7c-b5eb-76e8026722f6-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Lock "cinder-ff538187-a189-4c7c-b5eb-76e8026722f6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Acquiring lock "cinder-quobyte-ff538187-a189-4c7c-b5eb-76e8026722f6" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Lock "cinder-quobyte-ff538187-a189-4c7c-b5eb-76e8026722f6" acquired by "delete_volume" :: waited 0.019s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1423e651-5d7e-4254-99df-6c3eb9c1e589]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:04 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 Apr 16 22:20:04 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:04 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 1073741824" returned: 0 in 0.833s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Flow 'volume_create_manager' (ef4dda4c-d904-42b1-b4f1-aa8c2c802f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea972cae-6848-4955-b4d3-fe428ae57b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:04 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 Apr 16 22:20:04 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea972cae-6848-4955-b4d3-fe428ae57b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2106819794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0d04b4-4e85-45fb-a6a4-2d44a2021151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='623111e2c691425a9f4b8958edae3106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:05Z,use_quota=True,user_id='e01aee99c4934aa88ccdc2a069915ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab14d04b-cc50-4ec2-b8ba-7b2578adddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:04 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab14d04b-cc50-4ec2-b8ba-7b2578adddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc59254-126e-4915-a96e-a9d119eadf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc59254-126e-4915-a96e-a9d119eadf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb0d04b4-4e85-45fb-a6a4-2d44a2021151', 'volume_name': 'volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688c5f43-04b8-474a-b097-11e374429f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688c5f43-04b8-474a-b097-11e374429f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f991b8b-6812-4d42-9fb9-7a7381c185f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:04 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Volume cb0d04b4-4e85-45fb-a6a4-2d44a2021151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151', 'volume_size': 1} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78" returned: 0 in 0.791s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:04 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78 Apr 16 22:20:04 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:05 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6" returned: 0 in 0.909s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:05 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6 Apr 16 22:20:05 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:05 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2" returned: 0 in 0.498s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2106819794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0d04b4-4e85-45fb-a6a4-2d44a2021151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='623111e2c691425a9f4b8958edae3106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:05Z,use_quota=True,user_id='e01aee99c4934aa88ccdc2a069915ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Creating volume cb0d04b4-4e85-45fb-a6a4-2d44a2021151 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:05 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c7a76a-0935-42d8-ab54-2e847edaf8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5714c82-9895-4c22-b94b-a85664aeb0a2', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3763a0-4eb6-48fc-8ec1-301afcbbd211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:05 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 1073741824 Apr 16 22:20:05 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:05 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Volume volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 (e5714c82-9895-4c22-b94b-a85664aeb0a2): created successfully Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3763a0-4eb6-48fc-8ec1-301afcbbd211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (7f4272c2-4956-466e-854c-d35f7ff5d51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f8d56468-6100-4d56-9c8a-1b1f60cac70f tempest-VolumesGetTest-89660203 None] Created volume successfully. Apr 16 22:20:05 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eb6011f7-c738-4dd1-a2f9-c177f5705b78" returned: 0 in 0.612s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Lock "cinder-quobyte-eb6011f7-c738-4dd1-a2f9-c177f5705b78" released by "delete_volume" :: held 1.467s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Created reservations ['0a54a91a-427d-4c0e-921c-50dbc1d25777'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:05 devstack cinder-volume[82650]: WARNING cinder.quota [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1344899382 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1344899382, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Created reservations ['66fad44d-4e54-48fe-8084-49812ba56812', '1de9e9af-5469-4968-b011-fb586ff7c1f6', '76a4aca5-9b5d-4a22-b7b2-bbf8f1becc8a', 'd0bd1c55-c510-4065-8628-5b828bb9d3dc'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:05 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:05 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:05 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ff538187-a189-4c7c-b5eb-76e8026722f6" returned: 0 in 0.710s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Lock "cinder-quobyte-ff538187-a189-4c7c-b5eb-76e8026722f6" released by "delete_volume" :: held 1.696s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Created reservations ['c5b8da54-fe22-4c42-9c04-4c2e9ea12190', '3ae53dd6-16ab-4e16-b1c8-56dcfba710a0', 'ffa3de7d-3800-4c75-88c5-ad394f765f2e', 'c93dd6ca-9687-479b-a787-13d72a006f6b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:05 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 1073741824" returned: 0 in 0.789s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:06 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:06 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:06 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 Apr 16 22:20:06 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (6649ea6a-b87d-40bd-8c94-1816324cb796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ba8a49-7d9f-4cf1-9a98-6728bf4a4fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:06 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ba8a49-7d9f-4cf1-9a98-6728bf4a4fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-687598456',display_name='tempest-VolumesGetTest-Volume-1634327035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f8bf7c-38cc-4515-b6bf-379c85ef39bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:07Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bc5b60-722c-44b4-8f11-1264e430a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bc5b60-722c-44b4-8f11-1264e430a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73e54fb-7f15-4aa3-933b-a95aa9d69922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73e54fb-7f15-4aa3-933b-a95aa9d69922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f8bf7c-38cc-4515-b6bf-379c85ef39bc', 'volume_name': 'volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:06 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95651d5c-2689-4c7e-b614-191ad9e1badf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95651d5c-2689-4c7e-b614-191ad9e1badf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc101ef-e655-46b9-84c5-ce5b9c6b6ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:06 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Volume 47f8bf7c-38cc-4515-b6bf-379c85ef39bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc', 'volume_size': 1} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.274s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:06 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bea68171-3402-4172-9108-32304f27dad3 tempest-GroupSnapshotsV319Test-131685574 None] Delete group completed successfully. Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.888s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:06 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Deleted volume successfully. Apr 16 22:20:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-864dbe92-61cf-4276-91d3-d1ece0f24bef tempest-VolumesTransfersV357Test-614596501 None] Lock "cinder-ff538187-a189-4c7c-b5eb-76e8026722f6-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:07 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151" returned: 0 in 0.968s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-687598456',display_name='tempest-VolumesGetTest-Volume-1634327035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f8bf7c-38cc-4515-b6bf-379c85ef39bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:07Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Creating volume 47f8bf7c-38cc-4515-b6bf-379c85ef39bc {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:07 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f991b8b-6812-4d42-9fb9-7a7381c185f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:07 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc 1073741824 Apr 16 22:20:07 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0d4502-f548-4e41-87dc-9a8be2f2aaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Flow 'volume_create_manager' (25be94bd-2e06-429e-8193-d7374c7328fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adec4af9-312c-413c-83f9-ec9887908b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:07 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Volume volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 (cb0d04b4-4e85-45fb-a6a4-2d44a2021151): created successfully Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0d4502-f548-4e41-87dc-9a8be2f2aaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Flow 'volume_create_manager' (ef4dda4c-d904-42b1-b4f1-aa8c2c802f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adec4af9-312c-413c-83f9-ec9887908b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-356224752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f8dce2-e920-48a5-9f14-97c8d225a0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924b3cff3aeb46f690c3051cf9745f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:07Z,use_quota=True,user_id='60dcaed95004442d894193408de86d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e920b42-ea0d-41b5-9075-68a84c7bae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e920b42-ea0d-41b5-9075-68a84c7bae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b1c326-9e93-45ef-b700-387c29e40d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b1c326-9e93-45ef-b700-387c29e40d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f8dce2-e920-48a5-9f14-97c8d225a0dc', 'volume_name': 'volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a9ec74-b471-4e30-b98e-52eaa5313704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a9ec74-b471-4e30-b98e-52eaa5313704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd112d56-a527-4c3b-9100-b5a84c7f05a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:07 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Volume f6f8dce2-e920-48a5-9f14-97c8d225a0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc', 'volume_size': 1} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:07 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c6071a06-c91e-414e-9bf5-7fd695b3b4ac tempest-VolumesListAdminTestJSON-1366488192 None] Created volume successfully. Apr 16 22:20:07 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc 1073741824" returned: 0 in 0.889s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:07 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc Apr 16 22:20:07 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Flow 'volume_create_manager' (743456e6-a3cf-438d-9e54-167d2431c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52f3229-62ce-43ff-b58f-999b65277bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52f3229-62ce-43ff-b58f-999b65277bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2077791151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c460abb-21d5-460d-8a40-0ad1a9b9dd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='623111e2c691425a9f4b8958edae3106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:08Z,use_quota=True,user_id='e01aee99c4934aa88ccdc2a069915ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a39628-b228-4dfb-81b4-71eb326f7c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a39628-b228-4dfb-81b4-71eb326f7c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d53c1fd-de0d-44d3-894f-f9135214476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d53c1fd-de0d-44d3-894f-f9135214476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c460abb-21d5-460d-8a40-0ad1a9b9dd34', 'volume_name': 'volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e230f25f-91b0-452f-9be9-e0e788a02daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e230f25f-91b0-452f-9be9-e0e788a02daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7491e803-d144-408c-a055-7ace05247b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:08 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Volume 4c460abb-21d5-460d-8a40-0ad1a9b9dd34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34', 'volume_size': 1} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:08 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc" returned: 0 in 0.616s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-356224752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f8dce2-e920-48a5-9f14-97c8d225a0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924b3cff3aeb46f690c3051cf9745f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:07Z,use_quota=True,user_id='60dcaed95004442d894193408de86d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Creating volume f6f8dce2-e920-48a5-9f14-97c8d225a0dc {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:08 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc101ef-e655-46b9-84c5-ce5b9c6b6ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:08 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc 1073741824 Apr 16 22:20:08 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd536b8-151e-4d22-8999-e6993d46256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:08 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Volume volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc (47f8bf7c-38cc-4515-b6bf-379c85ef39bc): created successfully Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd536b8-151e-4d22-8999-e6993d46256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (6649ea6a-b87d-40bd-8c94-1816324cb796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4ffce104-54f7-4ccc-9e24-7db2ff1fedba tempest-VolumesGetTest-89660203 None] Created volume successfully. Apr 16 22:20:09 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc 1073741824" returned: 0 in 0.756s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:09 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc Apr 16 22:20:09 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-47f8bf7c-38cc-4515-b6bf-379c85ef39bc-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Lock "cinder-47f8bf7c-38cc-4515-b6bf-379c85ef39bc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:10 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-47f8bf7c-38cc-4515-b6bf-379c85ef39bc" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc" returned: 0 in 0.667s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2077791151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c460abb-21d5-460d-8a40-0ad1a9b9dd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='623111e2c691425a9f4b8958edae3106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:08Z,use_quota=True,user_id='e01aee99c4934aa88ccdc2a069915ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Creating volume 4c460abb-21d5-460d-8a40-0ad1a9b9dd34 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:10 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd112d56-a527-4c3b-9100-b5a84c7f05a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3d1331-cf9e-4499-87cc-da6171935508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:10 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 1073741824 Apr 16 22:20:10 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-47f8bf7c-38cc-4515-b6bf-379c85ef39bc" acquired by "delete_volume" :: waited 0.069s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:10 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Volume volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc (f6f8dce2-e920-48a5-9f14-97c8d225a0dc): created successfully Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3d1331-cf9e-4499-87cc-da6171935508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Flow 'volume_create_manager' (25be94bd-2e06-429e-8193-d7374c7328fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da55b58-8649-4a60-80fb-2c339dd17cb0]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:10 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-47f88c91-049d-44fd-8269-a0ce4fbef7c5 tempest-VolumesTransfersV357Test-548349264 None] Created volume successfully. Apr 16 22:20:10 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc Apr 16 22:20:10 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:10 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc" returned: 0 in 0.666s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:10 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc Apr 16 22:20:10 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:10 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 1073741824" returned: 0 in 0.793s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:10 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 Apr 16 22:20:10 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:11 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-47f8bf7c-38cc-4515-b6bf-379c85ef39bc" returned: 0 in 0.559s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-47f8bf7c-38cc-4515-b6bf-379c85ef39bc" released by "delete_volume" :: held 1.285s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Created reservations ['356945ff-dcba-4bcd-ae98-51b35039e527', 'cae4a4ed-8394-411e-8a40-d45166583cb6', '398234e2-ee33-44ac-9336-6a9435c7f4b8', '31e1afef-47f8-42e2-9ac8-3f26f276aed0'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:11 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34" returned: 0 in 0.646s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7491e803-d144-408c-a055-7ace05247b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b8f651-98e5-4f4f-bb1b-fbc497fc8b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:11 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Volume volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 (4c460abb-21d5-460d-8a40-0ad1a9b9dd34): created successfully Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b8f651-98e5-4f4f-bb1b-fbc497fc8b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Flow 'volume_create_manager' (743456e6-a3cf-438d-9e54-167d2431c339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:11 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:11 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-361572d9-81c3-465f-b251-25e10c0f70c8 tempest-VolumesListAdminTestJSON-1366488192 None] Created volume successfully. Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Acquiring lock "cinder-f6f8dce2-e920-48a5-9f14-97c8d225a0dc-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Lock "cinder-f6f8dce2-e920-48a5-9f14-97c8d225a0dc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Acquiring lock "cinder-quobyte-f6f8dce2-e920-48a5-9f14-97c8d225a0dc" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Lock "cinder-quobyte-f6f8dce2-e920-48a5-9f14-97c8d225a0dc" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c7302-5eab-4e3a-9413-458e3fc8e3e8]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:11 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc Apr 16 22:20:11 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:12 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.541s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:12 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Deleted volume successfully. Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-46c38ab5-4d7d-4f2e-814a-5a5a71ca52a3 tempest-VolumesGetTest-89660203 None] Lock "cinder-47f8bf7c-38cc-4515-b6bf-379c85ef39bc-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-e5714c82-9895-4c22-b94b-a85664aeb0a2-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Lock "cinder-e5714c82-9895-4c22-b94b-a85664aeb0a2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-e5714c82-9895-4c22-b94b-a85664aeb0a2" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-e5714c82-9895-4c22-b94b-a85664aeb0a2" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff5724d-a698-4e8a-94e4-23523c460e8a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:12 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 Apr 16 22:20:12 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:12 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc" returned: 0 in 0.744s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:12 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc Apr 16 22:20:12 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:13 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-f6f8dce2-e920-48a5-9f14-97c8d225a0dc" returned: 0 in 0.576s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Lock "cinder-quobyte-f6f8dce2-e920-48a5-9f14-97c8d225a0dc" released by "delete_volume" :: held 1.351s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Created reservations ['5848da7e-7250-431d-a7a7-3c0c5a71e628', '818b106e-304a-451d-8881-c883730b6788', '54920e19-e6c5-44db-b6d6-e55be3884f2d', '47f8cae7-e5f1-44f1-8a98-9e7d0d45cf70'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:13 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2" returned: 0 in 0.823s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:13 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:13 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:13 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2 Apr 16 22:20:13 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Flow 'volume_create_manager' (1f9cc598-ad6b-4207-a69d-da4b825ec6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4fa0c9-b3b3-4882-845b-c9577542dbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4fa0c9-b3b3-4882-845b-c9577542dbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10a800f-4893-4747-afd2-1dc8b78a0c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5344e500e24744ff96ee2b1565c96f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:13Z,use_quota=True,user_id='0ce9144285a44278b26cc11df79df983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cdd888d-1805-4239-80ba-898bc1bec84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cdd888d-1805-4239-80ba-898bc1bec84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89105051-e1f1-4512-85a8-b58a8067e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89105051-e1f1-4512-85a8-b58a8067e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10a800f-4893-4747-afd2-1dc8b78a0c13', 'volume_name': 'volume-d10a800f-4893-4747-afd2-1dc8b78a0c13', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b08344-ac7a-4071-80a5-a4a02ae52299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b08344-ac7a-4071-80a5-a4a02ae52299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf88101b-86db-4027-8825-777074b2abd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:13 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Volume d10a800f-4893-4747-afd2-1dc8b78a0c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10a800f-4893-4747-afd2-1dc8b78a0c13', 'volume_size': 1} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10a800f-4893-4747-afd2-1dc8b78a0c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5344e500e24744ff96ee2b1565c96f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:13Z,use_quota=True,user_id='0ce9144285a44278b26cc11df79df983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Creating volume d10a800f-4893-4747-afd2-1dc8b78a0c13 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:13 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:13 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 1073741824 Apr 16 22:20:13 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:13 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e5714c82-9895-4c22-b94b-a85664aeb0a2" returned: 0 in 0.621s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-e5714c82-9895-4c22-b94b-a85664aeb0a2" released by "delete_volume" :: held 1.480s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Created reservations ['f97fa32d-f8e8-4912-8c22-827e1cdb56a1', 'e28825e2-280a-4f06-9c5f-e45f03616426', '033dec56-8b69-4388-8616-1feb4068dee8', '0636f065-8ec3-47d9-8ad0-061d4a5bf3eb'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:13 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.720s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:13 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:13 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Deleted volume successfully. Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-821deeaf-ad7a-42cf-9264-7e7c860d021a tempest-VolumesTransfersV357Test-614596501 None] Lock "cinder-f6f8dce2-e920-48a5-9f14-97c8d225a0dc-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:14 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:14 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:14 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 1073741824" returned: 0 in 0.854s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:14 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 Apr 16 22:20:14 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:14 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.662s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:14 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Deleted volume successfully. Apr 16 22:20:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3f3cfca5-6169-4e27-a26e-d1812f28a873 tempest-VolumesGetTest-89660203 None] Lock "cinder-e5714c82-9895-4c22-b94b-a85664aeb0a2-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (b1ba5fc1-98e9-4c8d-8ab8-62074fd62090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1704e97-bc80-4973-8a04-ea8273cb4138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1704e97-bc80-4973-8a04-ea8273cb4138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1544920329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23380475-1599-4169-878f-ad36957872e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:15Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fd6bed-4e3f-4fcb-9af6-3305683f225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fd6bed-4e3f-4fcb-9af6-3305683f225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c49c040-ab12-4ad6-bb00-a2dd02e047b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c49c040-ab12-4ad6-bb00-a2dd02e047b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23380475-1599-4169-878f-ad36957872e4', 'volume_name': 'volume-23380475-1599-4169-878f-ad36957872e4', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e826375b-8b5e-45c4-8bb3-6d514244c2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e826375b-8b5e-45c4-8bb3-6d514244c2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69078c35-9a63-4d89-ad8c-343118baf2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:15 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Volume 23380475-1599-4169-878f-ad36957872e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23380475-1599-4169-878f-ad36957872e4', 'volume_size': 1} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:15 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13" returned: 0 in 0.730s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1544920329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23380475-1599-4169-878f-ad36957872e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:15Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Creating volume 23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:15 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf88101b-86db-4027-8825-777074b2abd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10a800f-4893-4747-afd2-1dc8b78a0c13', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608a58c1-9652-46cb-8982-33a3ccf78d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:15 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 1073741824 Apr 16 22:20:15 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:15 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Volume volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 (d10a800f-4893-4747-afd2-1dc8b78a0c13): created successfully Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608a58c1-9652-46cb-8982-33a3ccf78d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Flow 'volume_create_manager' (1f9cc598-ad6b-4207-a69d-da4b825ec6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:15 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-91681829-14d6-4e2d-b99a-664b8f424eda tempest-VolumesListAdminTestJSON-604624052 None] Created volume successfully. Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Acquiring lock "cinder-d10a800f-4893-4747-afd2-1dc8b78a0c13-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Lock "cinder-d10a800f-4893-4747-afd2-1dc8b78a0c13-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Acquiring lock "cinder-quobyte-d10a800f-4893-4747-afd2-1dc8b78a0c13" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Lock "cinder-quobyte-d10a800f-4893-4747-afd2-1dc8b78a0c13" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82f959-0b6c-4b33-ab3b-92cba852e39a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "cinder-4c460abb-21d5-460d-8a40-0ad1a9b9dd34-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-4c460abb-21d5-460d-8a40-0ad1a9b9dd34-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "cinder-quobyte-4c460abb-21d5-460d-8a40-0ad1a9b9dd34" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:16 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 Apr 16 22:20:16 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-quobyte-4c460abb-21d5-460d-8a40-0ad1a9b9dd34" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:16 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 1073741824" returned: 0 in 0.876s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[935866f5-d3b7-4a6b-a4fd-88fac6613243]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:16 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 Apr 16 22:20:16 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:16 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 Apr 16 22:20:16 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:16 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4" returned: 0 in 0.604s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:16 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69078c35-9a63-4d89-ad8c-343118baf2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23380475-1599-4169-878f-ad36957872e4', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec345672-893c-4ca4-9cee-e7fe98578dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13" returned: 0 in 0.873s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:16 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Volume volume-23380475-1599-4169-878f-ad36957872e4 (23380475-1599-4169-878f-ad36957872e4): created successfully Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec345672-893c-4ca4-9cee-e7fe98578dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (b1ba5fc1-98e9-4c8d-8ab8-62074fd62090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:16 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-98ddd902-4534-46fc-bdbf-de6e14070586 tempest-VolumesGetTest-89660203 None] Created volume successfully. Apr 16 22:20:16 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:16 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13 Apr 16 22:20:16 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34" returned: 0 in 0.733s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:16 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34 Apr 16 22:20:16 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:17 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-91d37b54-d9e4-4678-8d6e-3c3c4c0bcc24 tempest-GroupsV320Test-720721838 None] Group tempest-GroupsV320Test-Group-1285414497: creating Apr 16 22:20:17 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-91d37b54-d9e4-4678-8d6e-3c3c4c0bcc24 tempest-GroupsV320Test-720721838 None] Group tempest-GroupsV320Test-Group-1285414497: created successfully Apr 16 22:20:17 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-91d37b54-d9e4-4678-8d6e-3c3c4c0bcc24 tempest-GroupsV320Test-720721838 None] Create group completed successfully. Apr 16 22:20:17 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4c460abb-21d5-460d-8a40-0ad1a9b9dd34" returned: 0 in 0.557s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-quobyte-4c460abb-21d5-460d-8a40-0ad1a9b9dd34" released by "delete_volume" :: held 1.332s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Created reservations ['d3d09162-f5f6-4bed-9f0a-9116918caa6f', 'cde98e90-8c02-4bbc-910c-9972395df369', '2cd34b47-a4c9-472a-8536-7bbbc2cc54d9', '4202d962-ccab-4ee2-8370-3d2809e8acef'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:17 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:17 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:17 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d10a800f-4893-4747-afd2-1dc8b78a0c13" returned: 0 in 0.822s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Lock "cinder-quobyte-d10a800f-4893-4747-afd2-1dc8b78a0c13" released by "delete_volume" :: held 1.754s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Created reservations ['4a507121-9ac3-4a91-86bd-bfa85401717e', '5df70974-6091-4079-a90d-13fcab95d5f8', '16bd3796-4f3a-4921-9f06-0fd48045401e', 'e0520c85-2bdf-4927-89ad-f8bb47781e27'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (ecb1fa83-484b-44ea-a10a-2ab96b5567a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc13c34d-ac5d-46c8-bc3f-54213c8c8307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc13c34d-ac5d-46c8-bc3f-54213c8c8307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-49020262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3147c7-ee19-4a74-ae2f-cd089e405cab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=23380475-1599-4169-878f-ad36957872e4,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:18Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e5ead8-4d20-45dc-8e9e-c130fa274b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e5ead8-4d20-45dc-8e9e-c130fa274b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9c48a3-d01b-4d45-b3b1-669f4771cdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9c48a3-d01b-4d45-b3b1-669f4771cdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dc3147c7-ee19-4a74-ae2f-cd089e405cab', 'volume_name': 'volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab', 'volume_size': 1, 'source_volid': '23380475-1599-4169-878f-ad36957872e4', 'source_volstatus': 'available'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de2d49e-a995-418c-8f88-f1f8b04f9832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de2d49e-a995-418c-8f88-f1f8b04f9832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248e43e9-ef97-482a-8112-5a7eac37d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:17 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Volume dc3147c7-ee19-4a74-ae2f-cd089e405cab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab', 'volume_size': 1, 'source_volid': '23380475-1599-4169-878f-ad36957872e4', 'source_volstatus': 'available'} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:17 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Cloning volume 23380475-1599-4169-878f-ad36957872e4 to volume dc3147c7-ee19-4a74-ae2f-cd089e405cab Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Creating offline snapshot 23475931-a0ca-4d35-a87f-bc68223bdbf7 of volume 23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8384211d-5ad7-4fed-a413-99a703ebf0d8]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:17 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:17 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:17 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 Apr 16 22:20:17 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:18 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.575s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:18 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Deleted volume successfully. Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-51208f13-165f-45a1-b91b-550852cd102b tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-4c460abb-21d5-460d-8a40-0ad1a9b9dd34-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "cinder-cb0d04b4-4e85-45fb-a6a4-2d44a2021151-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-cb0d04b4-4e85-45fb-a6a4-2d44a2021151-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "cinder-quobyte-cb0d04b4-4e85-45fb-a6a4-2d44a2021151" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:18 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-quobyte-cb0d04b4-4e85-45fb-a6a4-2d44a2021151" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.654s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[373ff7c0-8aca-42fb-9c3f-4185e7412a12]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:18 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Deleted volume successfully. Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-300c3e18-723b-45db-a1f8-c6063c187ae4 tempest-VolumesListAdminTestJSON-604624052 None] Lock "cinder-d10a800f-4893-4747-afd2-1dc8b78a0c13-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:18 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4" returned: 0 in 0.884s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:18 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 Apr 16 22:20:18 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:18 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 1G Apr 16 22:20:18 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Created reservations ['58a8ec5b-5ce1-4a82-8819-48b30500094e'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:19 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:19 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:19 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151" returned: 0 in 0.761s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:19 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151 Apr 16 22:20:19 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:19 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 1G" returned: 0 in 0.689s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23380475-1599-4169-878f-ad36957872e4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:19 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23380475-1599-4169-878f-ad36957872e4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 Apr 16 22:20:19 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:19 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.650s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:19 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d9c3a0f5-5aaa-4d61-a796-c9054eb2182b tempest-GroupsV320Test-720721838 None] Delete group completed successfully. Apr 16 22:20:19 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cb0d04b4-4e85-45fb-a6a4-2d44a2021151" returned: 0 in 0.568s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-quobyte-cb0d04b4-4e85-45fb-a6a4-2d44a2021151" released by "delete_volume" :: held 1.387s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Flow 'volume_create_manager' (6b07ab5a-3708-4092-a31c-7f5b93899e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:19 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b572e39-90ae-44fe-9fb0-ea3eb5c9b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b572e39-90ae-44fe-9fb0-ea3eb5c9b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1485409806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74a0f6f-8efa-4a59-832e-82a952af9d91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea007f46a11748c89ae662116007f4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:20Z,use_quota=True,user_id='ab2010376a6749e7a8226270b33e79ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889bf1b4-ecb1-417b-a198-8104d9c21152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889bf1b4-ecb1-417b-a198-8104d9c21152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c26c32-63df-475d-9bbf-751809c7b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c26c32-63df-475d-9bbf-751809c7b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b74a0f6f-8efa-4a59-832e-82a952af9d91', 'volume_name': 'volume-b74a0f6f-8efa-4a59-832e-82a952af9d91', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a57892-be8c-4c6c-9644-de7863c667ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a57892-be8c-4c6c-9644-de7863c667ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33001a51-6f0b-4a5b-bb5a-85a0fa6c1d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:20 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Volume b74a0f6f-8efa-4a59-832e-82a952af9d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b74a0f6f-8efa-4a59-832e-82a952af9d91', 'volume_size': 1} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Created reservations ['801a3aee-1cc1-456e-b8f2-88ffd952a211', 'd2345d69-f1b8-48c7-bc05-a5d631c287aa', '1e3c6236-769f-4853-a29a-5c9a08de9478', 'be640f5f-b055-4653-b280-c7d239863038'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:20 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23380475-1599-4169-878f-ad36957872e4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7" returned: 0 in 0.716s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:20 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 is being set with open permissions: ugo+rw Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:20 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 Apr 16 22:20:20 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:20 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:20 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "cinder-fa8cd2b1-1dc1-4345-a395-a5d2f7384256-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:20 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:20 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-fa8cd2b1-1dc1-4345-a395-a5d2f7384256-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7" returned: 0 in 0.674s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.649s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:20 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Deleted volume successfully. Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-49e3ded4-3b3f-47b1-9d02-8808a0f63fe7 tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-cb0d04b4-4e85-45fb-a6a4-2d44a2021151-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:20 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.info Apr 16 22:20:20 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "cinder-quobyte-fa8cd2b1-1dc1-4345-a395-a5d2f7384256" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-quobyte-fa8cd2b1-1dc1-4345-a395-a5d2f7384256" acquired by "delete_volume" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19560c4-e349-4448-b5b0-df7117f7b311]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:21 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 Apr 16 22:20:21 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:21 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.info" returned: 0 in 0.676s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:21 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.info is being set with open permissions: ugo+rw Apr 16 22:20:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:21 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.info Apr 16 22:20:21 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:21 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256" returned: 0 in 0.790s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:21 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256 Apr 16 22:20:21 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:22 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.info" returned: 0 in 0.550s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-dc3147c7-ee19-4a74-ae2f-cd089e405cab" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-dc3147c7-ee19-4a74-ae2f-cd089e405cab" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] snapshot: 23475931-a0ca-4d35-a87f-bc68223bdbf7, volume: dc3147c7-ee19-4a74-ae2f-cd089e405cab, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc507b39-64d5-455c-9c6c-15076647cbf7]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:22 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 Apr 16 22:20:22 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:22 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fa8cd2b1-1dc1-4345-a395-a5d2f7384256" returned: 0 in 0.542s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-quobyte-fa8cd2b1-1dc1-4345-a395-a5d2f7384256" released by "delete_volume" :: held 1.363s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Created reservations ['92674e3c-4335-4360-9578-08c50ac857d7', '18146517-f57a-45b4-953e-6f3f8421f70d', '2288069e-102e-4192-a2d7-c9879da487ae', '2fad16d2-bf78-4f43-adaf-b9cfd8dfe3b0'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:22 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:22 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:22 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7" returned: 0 in 0.693s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23380475-1599-4169-878f-ad36957872e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75cf0a3-8be1-46b6-b3b7-d31dfc5e7500]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:22 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 Apr 16 22:20:22 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:23 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.628s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:23 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Deleted volume successfully. Apr 16 22:20:23 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=146,cinder:INSERT=52,cinder:UPDATE=157,cinder:DELETE=10 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:20:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d464099b-b392-4068-ad0e-1abc979bbeda tempest-VolumesListAdminTestJSON-1366488192 None] Lock "cinder-fa8cd2b1-1dc1-4345-a395-a5d2f7384256-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:23 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4" returned: 0 in 0.629s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:23 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:20:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:23 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab Apr 16 22:20:23 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:20:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:24 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:24 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:26 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 2.282s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:26 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:26 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:20:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:20:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:20:26 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab" returned: 0 in 3.259s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:26 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f63c20c-9a81-4cb3-acd0-8ad941ccbfb8]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:26 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 Apr 16 22:20:26 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:27 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4" returned: 0 in 1.011s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:27 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4, size 1024.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:20:27 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Converted 1024.00 MB image at 314.12 MB/s Apr 16 22:20:27 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab is being set with open permissions: ugo+rw Apr 16 22:20:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:27 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab Apr 16 22:20:27 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:28 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab" returned: 0 in 0.651s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-dc3147c7-ee19-4a74-ae2f-cd089e405cab" released by "_copy_volume_from_snapshot" :: held 6.314s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-23475931-a0ca-4d35-a87f-bc68223bdbf7" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-23475931-a0ca-4d35-a87f-bc68223bdbf7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Deleting offline snapshot 23475931-a0ca-4d35-a87f-bc68223bdbf7 of volume 23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:20:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] snapshot_file for this snap is: volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:20:28 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd027fdb-8870-40e4-99e4-e7c42474a54d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:28 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 Apr 16 22:20:28 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:29 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7" returned: 0 in 0.847s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23380475-1599-4169-878f-ad36957872e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e20cb73-ea9b-45fa-97da-7087b486e188]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:29 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 Apr 16 22:20:29 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=134,cinder:INSERT=42,cinder:UPDATE=189,cinder:DELETE=15 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Flow 'volume_create_manager' (3c347be0-0b61-477b-a10f-c1a605568adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c612bf9a-c3b6-4e3d-a29b-dff71aa07bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c612bf9a-c3b6-4e3d-a29b-dff71aa07bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-903832206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c45667-1bfc-4431-a72b-b5c51429d5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcf3c9bb5544bd69cab02b231c42c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:30Z,use_quota=True,user_id='c77714b6e4fe4f34a9052182de76cc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde2040f-32ff-4959-be1b-9cb096b8da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde2040f-32ff-4959-be1b-9cb096b8da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452c35f5-1ec0-433f-b8a6-b802dfbc40aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452c35f5-1ec0-433f-b8a6-b802dfbc40aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c45667-1bfc-4431-a72b-b5c51429d5ce', 'volume_name': 'volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbceb899-1c6c-4766-a074-05f10bfa1e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbceb899-1c6c-4766-a074-05f10bfa1e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe35c293-a74f-4cc9-9973-9cd98e1ecca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:30 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Volume e1c45667-1bfc-4431-a72b-b5c51429d5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce', 'volume_size': 1} Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:30 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4" returned: 0 in 0.751s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:30 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 Apr 16 22:20:30 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:30 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7" returned: 0 in 0.541s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:30 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7 Apr 16 22:20:30 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:31 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4.23475931-a0ca-4d35-a87f-bc68223bdbf7" returned: 0 in 0.578s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-23475931-a0ca-4d35-a87f-bc68223bdbf7" released by "_delete_snapshot" :: held 2.796s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.482s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.253s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1485409806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74a0f6f-8efa-4a59-832e-82a952af9d91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea007f46a11748c89ae662116007f4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:20Z,use_quota=True,user_id='ab2010376a6749e7a8226270b33e79ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Creating volume b74a0f6f-8efa-4a59-832e-82a952af9d91 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:31 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:31 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 1073741824 Apr 16 22:20:31 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248e43e9-ef97-482a-8112-5a7eac37d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab', 'volume_size': 1, 'source_volid': '23380475-1599-4169-878f-ad36957872e4', 'source_volstatus': 'available'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf07c5e5-5595-4f89-92f3-df4f0692e4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:31 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Volume volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab (dc3147c7-ee19-4a74-ae2f-cd089e405cab): created successfully Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf07c5e5-5595-4f89-92f3-df4f0692e4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (ecb1fa83-484b-44ea-a10a-2ab96b5567a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:31 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c0262587-59df-406e-b72d-2dd27ae78e0c tempest-VolumesGetTest-89660203 None] Created volume successfully. Apr 16 22:20:32 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 1073741824" returned: 0 in 0.915s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:32 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 Apr 16 22:20:32 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (c2cd56ca-1e0e-40a7-84f9-49590cc895f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142c2fad-303c-4c8d-94ce-b8a0efd22d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142c2fad-303c-4c8d-94ce-b8a0efd22d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-22007011',display_name='tempest-VolumesGetTest-Volume-11623641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5878c8a4-103e-40e7-8582-7dc345981bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:33Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8508fce3-b719-42a9-9e59-75f38d52aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8508fce3-b719-42a9-9e59-75f38d52aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d99bf4d-a63c-4c13-b4b3-c1a0af07780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d99bf4d-a63c-4c13-b4b3-c1a0af07780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5878c8a4-103e-40e7-8582-7dc345981bd1', 'volume_name': 'volume-5878c8a4-103e-40e7-8582-7dc345981bd1', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80bd45e-5fe5-4d73-8fe7-febf3290afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80bd45e-5fe5-4d73-8fe7-febf3290afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efdc0ea-bc2d-4814-963b-213b9b53bbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Volume 5878c8a4-103e-40e7-8582-7dc345981bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5878c8a4-103e-40e7-8582-7dc345981bd1', 'volume_size': 1} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:32 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91" returned: 0 in 0.579s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.852s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-903832206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c45667-1bfc-4431-a72b-b5c51429d5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcf3c9bb5544bd69cab02b231c42c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:30Z,use_quota=True,user_id='c77714b6e4fe4f34a9052182de76cc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Creating volume e1c45667-1bfc-4431-a72b-b5c51429d5ce {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:32 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:32 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce 1073741824 Apr 16 22:20:32 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33001a51-6f0b-4a5b-bb5a-85a0fa6c1d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74a0f6f-8efa-4a59-832e-82a952af9d91', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cf0d74-4a99-4b91-8aea-7e3655f238e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Volume volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 (b74a0f6f-8efa-4a59-832e-82a952af9d91): created successfully Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cf0d74-4a99-4b91-8aea-7e3655f238e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Flow 'volume_create_manager' (6b07ab5a-3708-4092-a31c-7f5b93899e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:32 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1ae39130-c151-4e81-a113-bb9001ee1433 tempest-VolumesListTestJSON-431524923 None] Created volume successfully. Apr 16 22:20:33 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce 1073741824" returned: 0 in 0.658s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:33 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce Apr 16 22:20:33 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Flow 'volume_create_manager' (57221314-e107-410a-b76d-35f7b7465489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72466a0-fb4b-4fc0-85b4-91551a0a1198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72466a0-fb4b-4fc0-85b4-91551a0a1198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2126774417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666ac04b-6053-4f0a-838b-202885ab17f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd965cb5ff04eceae937e251c3b034e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:34Z,use_quota=True,user_id='6081949c3ea94d54beb95277fdebb443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aeeeac7-e66a-4efc-a661-c7802922637f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aeeeac7-e66a-4efc-a661-c7802922637f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2188ff4-ca01-4f29-a5ab-6ba83dbdc3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2188ff4-ca01-4f29-a5ab-6ba83dbdc3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666ac04b-6053-4f0a-838b-202885ab17f5', 'volume_name': 'volume-666ac04b-6053-4f0a-838b-202885ab17f5', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160df39b-1f9e-4939-b555-5b7e57e20bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160df39b-1f9e-4939-b555-5b7e57e20bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234705f5-8492-4ce5-9078-3635a9eb25d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Volume 666ac04b-6053-4f0a-838b-202885ab17f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666ac04b-6053-4f0a-838b-202885ab17f5', 'volume_size': 1} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Flow 'volume_create_manager' (4e632944-6796-4d0d-af4b-687e21afadce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96228fe6-b6dc-43e2-8399-353f7fff862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96228fe6-b6dc-43e2-8399-353f7fff862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1602886329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158833b6-e110-465c-b41a-14c95462c741,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea007f46a11748c89ae662116007f4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:34Z,use_quota=True,user_id='ab2010376a6749e7a8226270b33e79ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c455c872-361d-4f4b-8a3b-dcd28cf54b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c455c872-361d-4f4b-8a3b-dcd28cf54b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01df9577-2e52-4da0-a0ef-b515e561caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01df9577-2e52-4da0-a0ef-b515e561caaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158833b6-e110-465c-b41a-14c95462c741', 'volume_name': 'volume-158833b6-e110-465c-b41a-14c95462c741', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b18d9a7-a208-4f91-ad8b-a2c27586d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b18d9a7-a208-4f91-ad8b-a2c27586d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a974944e-5ec2-4828-b29d-613a7eba0b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:33 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Volume 158833b6-e110-465c-b41a-14c95462c741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158833b6-e110-465c-b41a-14c95462c741', 'volume_size': 1} Apr 16 22:20:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:34 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce" returned: 0 in 0.526s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-22007011',display_name='tempest-VolumesGetTest-Volume-11623641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5878c8a4-103e-40e7-8582-7dc345981bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:33Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Creating volume 5878c8a4-103e-40e7-8582-7dc345981bd1 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:34 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe35c293-a74f-4cc9-9973-9cd98e1ecca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f1ea78-119c-49a2-9f07-5b6205d5d9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:34 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 1073741824 Apr 16 22:20:34 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:34 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Volume volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce (e1c45667-1bfc-4431-a72b-b5c51429d5ce): created successfully Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f1ea78-119c-49a2-9f07-5b6205d5d9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Flow 'volume_create_manager' (3c347be0-0b61-477b-a10f-c1a605568adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:34 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-651f80bc-d6c5-42d0-8de6-3be0de45eabc tempest-AbsoluteLimitsTests-1894347868 None] Created volume successfully. Apr 16 22:20:34 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 1073741824" returned: 0 in 0.677s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:34 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 Apr 16 22:20:34 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Acquiring lock "cinder-e1c45667-1bfc-4431-a72b-b5c51429d5ce-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Lock "cinder-e1c45667-1bfc-4431-a72b-b5c51429d5ce-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Acquiring lock "cinder-quobyte-e1c45667-1bfc-4431-a72b-b5c51429d5ce" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:35 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Lock "cinder-quobyte-e1c45667-1bfc-4431-a72b-b5c51429d5ce" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1" returned: 0 in 0.564s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf1bdbf-f797-4289-aeca-bbbf8ba005f0]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2126774417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666ac04b-6053-4f0a-838b-202885ab17f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd965cb5ff04eceae937e251c3b034e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:34Z,use_quota=True,user_id='6081949c3ea94d54beb95277fdebb443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Creating volume 666ac04b-6053-4f0a-838b-202885ab17f5 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:35 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efdc0ea-bc2d-4814-963b-213b9b53bbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5878c8a4-103e-40e7-8582-7dc345981bd1', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:35 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 1073741824 Apr 16 22:20:35 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebea2084-a2aa-4e89-8bfb-f61ab1a0885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Volume volume-5878c8a4-103e-40e7-8582-7dc345981bd1 (5878c8a4-103e-40e7-8582-7dc345981bd1): created successfully Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebea2084-a2aa-4e89-8bfb-f61ab1a0885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (c2cd56ca-1e0e-40a7-84f9-49590cc895f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:35 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8353a093-31c8-44ef-829d-acccb1f7231a tempest-VolumesGetTest-89660203 None] Created volume successfully. Apr 16 22:20:35 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce Apr 16 22:20:35 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-5878c8a4-103e-40e7-8582-7dc345981bd1-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Lock "cinder-5878c8a4-103e-40e7-8582-7dc345981bd1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-5878c8a4-103e-40e7-8582-7dc345981bd1" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-5878c8a4-103e-40e7-8582-7dc345981bd1" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cd0fe1-899c-4f91-9e2e-35b123a7a484]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:36 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 1073741824" returned: 0 in 0.620s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:36 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce" returned: 0 in 0.646s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:36 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 Apr 16 22:20:36 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:36 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce Apr 16 22:20:36 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:36 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 Apr 16 22:20:36 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:36 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e1c45667-1bfc-4431-a72b-b5c51429d5ce" returned: 0 in 0.475s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Lock "cinder-quobyte-e1c45667-1bfc-4431-a72b-b5c51429d5ce" released by "delete_volume" :: held 1.167s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:36 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1" returned: 0 in 0.534s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:36 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1 Apr 16 22:20:36 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Created reservations ['f11bffb4-e527-4ea2-8eb8-37b15c37067c', '3fb59946-4eba-40e7-9512-2fa7352b2618', 'e5f2cd3a-382f-4d38-ac53-a00798fc9707', 'f236625e-c9ca-4bc2-8f93-1b6edae3da6a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:36 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5" returned: 0 in 0.554s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.811s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1602886329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158833b6-e110-465c-b41a-14c95462c741,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea007f46a11748c89ae662116007f4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:34Z,use_quota=True,user_id='ab2010376a6749e7a8226270b33e79ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Creating volume 158833b6-e110-465c-b41a-14c95462c741 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:36 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:36 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 1073741824 Apr 16 22:20:36 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234705f5-8492-4ce5-9078-3635a9eb25d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666ac04b-6053-4f0a-838b-202885ab17f5', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9414ac1-2ada-4236-9806-97819f50bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:36 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Volume volume-666ac04b-6053-4f0a-838b-202885ab17f5 (666ac04b-6053-4f0a-838b-202885ab17f5): created successfully Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9414ac1-2ada-4236-9806-97819f50bcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Flow 'volume_create_manager' (57221314-e107-410a-b76d-35f7b7465489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:36 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6c93498e-4040-4179-b37c-66c1911c41cb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Created volume successfully. Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:36 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:36 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Acquiring lock "cinder-666ac04b-6053-4f0a-838b-202885ab17f5-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "cinder-666ac04b-6053-4f0a-838b-202885ab17f5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Acquiring lock "cinder-quobyte-666ac04b-6053-4f0a-838b-202885ab17f5" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "cinder-quobyte-666ac04b-6053-4f0a-838b-202885ab17f5" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5085333d-f98b-4f78-9a5a-004117b5b60e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:37 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 Apr 16 22:20:37 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:37 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5878c8a4-103e-40e7-8582-7dc345981bd1" returned: 0 in 0.649s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:37 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-5878c8a4-103e-40e7-8582-7dc345981bd1" released by "delete_volume" :: held 1.206s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 1073741824" returned: 0 in 0.594s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:37 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Created reservations ['f4fbda0e-9f39-4dd7-a299-ebb8eb835b64', 'b9f20eb0-bb5a-4c28-92a8-77f545428938', '5979b08a-5a0f-434f-bcdf-bd46dbe9edd9', '2b15f1aa-4e28-4e0b-ac05-e9ca72281414'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:37 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:37 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.577s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Deleted volume successfully. Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-054b4349-6a48-42d4-9c7d-89c3c222e65c tempest-AbsoluteLimitsTests-1894347868 None] Lock "cinder-e1c45667-1bfc-4431-a72b-b5c51429d5ce-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:37 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:37 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:37 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5" returned: 0 in 0.654s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:37 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5 Apr 16 22:20:37 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:37 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741" returned: 0 in 0.502s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a974944e-5ec2-4828-b29d-613a7eba0b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158833b6-e110-465c-b41a-14c95462c741', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f2eb1b-f728-44fd-8b57-91566edf2efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:37 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Volume volume-158833b6-e110-465c-b41a-14c95462c741 (158833b6-e110-465c-b41a-14c95462c741): created successfully Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f2eb1b-f728-44fd-8b57-91566edf2efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Flow 'volume_create_manager' (4e632944-6796-4d0d-af4b-687e21afadce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-59e43752-ee80-45f7-aab7-ba0912a9bbc7 tempest-VolumesListTestJSON-431524923 None] Created volume successfully. Apr 16 22:20:37 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.494s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Deleted volume successfully. Apr 16 22:20:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71b1cec0-5ba1-4be7-842d-081506ea348d tempest-VolumesGetTest-89660203 None] Lock "cinder-5878c8a4-103e-40e7-8582-7dc345981bd1-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:38 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-dc3147c7-ee19-4a74-ae2f-cd089e405cab-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-666ac04b-6053-4f0a-838b-202885ab17f5" returned: 0 in 0.617s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Lock "cinder-dc3147c7-ee19-4a74-ae2f-cd089e405cab-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "cinder-quobyte-666ac04b-6053-4f0a-838b-202885ab17f5" released by "delete_volume" :: held 1.302s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-dc3147c7-ee19-4a74-ae2f-cd089e405cab" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-dc3147c7-ee19-4a74-ae2f-cd089e405cab" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0335763-d92e-4eae-91e5-a485ff7840d3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Created reservations ['5f09fb1a-722c-4073-967b-34e14f88d053', '575e36d3-bd60-411f-8409-8cd18e87bc6e', 'b8f5340c-edc2-47c3-9d07-aff3e609c8e1', 'b94f3995-7193-49e8-a837-54cda53c9c90'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:38 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab Apr 16 22:20:38 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:38 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:38 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:38 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.553s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:38 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Deleted volume successfully. Apr 16 22:20:38 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab" returned: 0 in 0.648s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf79bd6a-6b84-4396-b9e4-e7a8b9db63bb tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "cinder-666ac04b-6053-4f0a-838b-202885ab17f5-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:38 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab Apr 16 22:20:38 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Flow 'volume_create_manager' (6131a6e0-3e9f-439a-94fe-2dd150ed32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ef83c7-4ab8-466e-ada8-a2fa77e77474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ef83c7-4ab8-466e-ada8-a2fa77e77474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-172766339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4937ce2-6fd8-4b09-9e46-f47ce6f5752b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea007f46a11748c89ae662116007f4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:39Z,use_quota=True,user_id='ab2010376a6749e7a8226270b33e79ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac370a-9c18-4c22-a0a5-56befbefdcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac370a-9c18-4c22-a0a5-56befbefdcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3844e8-caf5-4300-b10e-c9bf10045006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3844e8-caf5-4300-b10e-c9bf10045006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4937ce2-6fd8-4b09-9e46-f47ce6f5752b', 'volume_name': 'volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c441de58-a73e-4832-9502-07acc393caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c441de58-a73e-4832-9502-07acc393caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cb60fe-79b9-4e07-b565-c0f725b6d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Volume e4937ce2-6fd8-4b09-9e46-f47ce6f5752b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b', 'volume_size': 1} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-172766339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4937ce2-6fd8-4b09-9e46-f47ce6f5752b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea007f46a11748c89ae662116007f4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:39Z,use_quota=True,user_id='ab2010376a6749e7a8226270b33e79ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Creating volume e4937ce2-6fd8-4b09-9e46-f47ce6f5752b {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:39 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:39 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b 1073741824 Apr 16 22:20:39 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:39 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-dc3147c7-ee19-4a74-ae2f-cd089e405cab" returned: 0 in 0.655s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Flow 'volume_create_manager' (61134513-da62-4ba4-82f4-a5d41ca19c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02faf322-be86-43ad-86de-f93c6ec92ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-dc3147c7-ee19-4a74-ae2f-cd089e405cab" released by "delete_volume" :: held 1.381s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02faf322-be86-43ad-86de-f93c6ec92ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-810409660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd965cb5ff04eceae937e251c3b034e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:40Z,use_quota=True,user_id='6081949c3ea94d54beb95277fdebb443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9349551a-4710-4c21-8cf9-89fce57708a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9349551a-4710-4c21-8cf9-89fce57708a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d993425e-2a5a-451d-aed7-257bce066631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d993425e-2a5a-451d-aed7-257bce066631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5', 'volume_name': 'volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52fac84-45be-4200-a256-3235fd2899a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52fac84-45be-4200-a256-3235fd2899a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92110a29-5667-4ae1-ab76-6f7c69e65683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:39 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Volume 91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5', 'volume_size': 1} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Created reservations ['2f0dbeca-4bec-4020-9e5c-f5bbeda3465b', '76656414-f3d5-4071-aa6d-24349703d273', 'e31e5c28-c645-4fe1-8dcc-6c704e7a82c6', '6ba9c7bd-da7e-4676-95e8-f425570bdce5'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:39 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:39 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:40 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b 1073741824" returned: 0 in 0.797s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:40 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b Apr 16 22:20:40 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:40 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.525s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:40 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Deleted volume successfully. Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-96770019-8ba4-4a3d-bf1d-62280a32cc13 tempest-VolumesGetTest-89660203 None] Lock "cinder-dc3147c7-ee19-4a74-ae2f-cd089e405cab-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-23380475-1599-4169-878f-ad36957872e4-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Lock "cinder-23380475-1599-4169-878f-ad36957872e4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-23380475-1599-4169-878f-ad36957872e4" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-23380475-1599-4169-878f-ad36957872e4" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d9b68-5464-4b30-b074-4cc4758789cf]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:40 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 Apr 16 22:20:40 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Flow 'volume_create_manager' (2e5c009f-7816-4bd2-b144-d8f127623158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f864cda-d0b0-42ec-b2a4-8017ead55d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f864cda-d0b0-42ec-b2a4-8017ead55d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1034587046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19c8604-0e13-46bb-9c1a-f5c5c07907a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5238926d66f4667abeda922deec5a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:41Z,use_quota=True,user_id='b336a687e1f348cfbda8ad9ddbc45272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26058ebd-823f-4d9e-b474-ad783b3d7727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26058ebd-823f-4d9e-b474-ad783b3d7727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bbcf70-2878-4809-b072-db195722f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bbcf70-2878-4809-b072-db195722f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19c8604-0e13-46bb-9c1a-f5c5c07907a4', 'volume_name': 'volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:40 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5e25d7-f7f5-40db-a49b-0456b8e1b821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5e25d7-f7f5-40db-a49b-0456b8e1b821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065fe78d-19ab-4175-988f-beede7c9f6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:40 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Volume d19c8604-0e13-46bb-9c1a-f5c5c07907a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4', 'volume_size': 1} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b" returned: 0 in 0.589s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-810409660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd965cb5ff04eceae937e251c3b034e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:40Z,use_quota=True,user_id='6081949c3ea94d54beb95277fdebb443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Creating volume 91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:40 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cb60fe-79b9-4e07-b565-c0f725b6d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15d9209-3cf1-4090-8ec8-83520c2b5f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:40 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 1073741824 Apr 16 22:20:40 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:40 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Volume volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b (e4937ce2-6fd8-4b09-9e46-f47ce6f5752b): created successfully Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15d9209-3cf1-4090-8ec8-83520c2b5f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Flow 'volume_create_manager' (6131a6e0-3e9f-439a-94fe-2dd150ed32a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:40 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a2200fa9-6513-42f5-9d2d-e787d6d1aa24 tempest-VolumesListTestJSON-431524923 None] Created volume successfully. Apr 16 22:20:41 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4" returned: 0 in 0.572s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:41 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4 Apr 16 22:20:41 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:41 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 1073741824" returned: 0 in 0.567s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:41 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 Apr 16 22:20:41 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:41 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-23380475-1599-4169-878f-ad36957872e4" returned: 0 in 0.547s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-23380475-1599-4169-878f-ad36957872e4" released by "delete_volume" :: held 1.180s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Created reservations ['1491a297-6563-433d-9699-07f3da46181a', '29045037-5158-42ea-8251-2b6975e90064', 'a8e00324-ddf3-4a81-9cff-47d31599611d', '11a3a50b-4488-4c3e-a305-5595c9ae9a75'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:41 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:41 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:42 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5" returned: 0 in 0.558s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1034587046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19c8604-0e13-46bb-9c1a-f5c5c07907a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5238926d66f4667abeda922deec5a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:41Z,use_quota=True,user_id='b336a687e1f348cfbda8ad9ddbc45272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Creating volume d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:42 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92110a29-5667-4ae1-ab76-6f7c69e65683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffef9653-f751-4592-8976-42e8afd939a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:42 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 1073741824 Apr 16 22:20:42 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:42 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Volume volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 (91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5): created successfully Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffef9653-f751-4592-8976-42e8afd939a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Flow 'volume_create_manager' (61134513-da62-4ba4-82f4-a5d41ca19c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6e5ec2e2-a558-47d8-b430-99e9bad048f0 tempest-VolumeQuotasAdminTestJSON-1532467788 None] Created volume successfully. Apr 16 22:20:42 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.630s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Deleted volume successfully. Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3ad08b65-9537-4cef-9a38-95aaae0d4a24 tempest-VolumesGetTest-89660203 None] Lock "cinder-23380475-1599-4169-878f-ad36957872e4-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:42 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 1073741824" returned: 0 in 0.767s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:42 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 Apr 16 22:20:42 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (940af2ac-27e7-4f87-b55a-4248c596f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd98ba2-b0d4-4989-9609-369e4c3d7901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd98ba2-b0d4-4989-9609-369e4c3d7901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1327918835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de07c23-cbd8-40a3-8ae0-0c8d60df1040,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:43Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80796f9-af9f-49c4-abdc-3383340a2913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80796f9-af9f-49c4-abdc-3383340a2913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe7b184-7923-445f-85d1-d657ea10b3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.image.glance [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Creating Keystone auth plugin from conf {{(pid=82650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 22:20:43 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" returned: 0 in 0.590s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065fe78d-19ab-4175-988f-beede7c9f6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773c5b75-d5bb-4eda-af5d-e9879285352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:43 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Volume volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 (d19c8604-0e13-46bb-9c1a-f5c5c07907a4): created successfully Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773c5b75-d5bb-4eda-af5d-e9879285352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Flow 'volume_create_manager' (2e5c009f-7816-4bd2-b144-d8f127623158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-47863a4d-6283-4754-b709-b6f242130241 tempest-VolumesDeleteCascade-329088807 None] Created volume successfully. Apr 16 22:20:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-88c1b341-26ca-446f-828c-d70025553d28 tempest-VolumeQuotasAdminTestJSON-2014027844 None] Transfer volume completed successfully. Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe7b184-7923-445f-85d1-d657ea10b3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3de07c23-cbd8-40a3-8ae0-0c8d60df1040', 'volume_name': 'volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b90a6f-e5a1-4f07-b235-a27f0b8ab679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b90a6f-e5a1-4f07-b235-a27f0b8ab679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a20fe5-d3da-457b-9509-f08977960447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:43 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Volume 3de07c23-cbd8-40a3-8ae0-0c8d60df1040: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Trying to clone 3de07c23-cbd8-40a3-8ae0-0c8d60df1040 from image fc1a3fa2-bedc-4143-856a-42ade81658d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]). {{(pid=82650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 22:20:43 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Image download 20.69 MB at 20.69 MB/s Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[77139ae8-0d9f-402f-9267-ad8faec0f79c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Acquiring lock "cinder-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Lock "cinder-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Acquiring lock "cinder-quobyte-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Lock "cinder-quobyte-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:43 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD Apr 16 22:20:43 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[714d87c3-2227-4744-ab17-ac79a2cc4495]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:44 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b Apr 16 22:20:44 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Creating offline snapshot d6abc8b6-c6cb-47f4-88e2-14d757f597b4 of volume d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb36cb97-d981-4f87-9f7d-aa0e2accf54e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Acquiring lock "cinder-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Lock "cinder-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Acquiring lock "cinder-quobyte-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Lock "cinder-quobyte-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[917e237f-1086-4c9a-99e6-d625c7b29faf]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:44 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 Apr 16 22:20:44 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:44 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 Apr 16 22:20:44 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:44 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b" returned: 0 in 0.675s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:44 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD" returned: 0 in 0.794s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Temporary image fc1a3fa2-bedc-4143-856a-42ade81658d5 is fetched for user d56fc4c1482a4ae7a2516a0f46b3ec79. {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 22:20:44 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b Apr 16 22:20:44 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac72c2e7-cebe-4025-bc9b-b6129906e85f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:44 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD Apr 16 22:20:44 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:45 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:45 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" returned: 0 in 0.798s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b" returned: 0 in 0.503s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Lock "cinder-quobyte-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b" released by "delete_volume" :: held 1.211s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:45 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 1G Apr 16 22:20:45 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Created reservations ['4da799ec-22bf-43cc-a02d-c37e4a9b38b0', 'a7bdfc6b-017f-4c6a-99bd-f1ff59a79fe6', 'f965dcc1-47af-4cdc-91ee-c49610108c0f', '562c3ed2-a437-4b0f-a700-36981f7280a0'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:45 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5" returned: 0 in 0.743s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:45 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5 Apr 16 22:20:45 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:45 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:45 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:45 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD" returned: 0 in 0.646s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:45 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 1G" returned: 0 in 0.640s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:45 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 Apr 16 22:20:45 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:45 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5" returned: 0 in 0.637s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Lock "cinder-quobyte-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5" released by "delete_volume" :: held 1.418s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:45 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.624s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:45 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Deleted volume successfully. Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Created reservations ['72c6ee97-79de-4148-85d9-ebd7d284a3e4', 'f89124ca-add6-4a71-935d-cf5055422398', '9fe67e0d-10c0-441b-aeec-6db35d01e6bb', '9d16c3d7-2806-4ab9-a113-e0d746a34f56'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b47be0e4-f729-4e8e-8c04-1d9357ddb9da tempest-VolumesListTestJSON-431524923 None] Lock "cinder-e4937ce2-6fd8-4b09-9e46-f47ce6f5752b-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:46 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:46 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "cinder-158833b6-e110-465c-b41a-14c95462c741-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Lock "cinder-158833b6-e110-465c-b41a-14c95462c741-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "cinder-quobyte-158833b6-e110-465c-b41a-14c95462c741" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Lock "cinder-quobyte-158833b6-e110-465c-b41a-14c95462c741" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:46 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb98fe7-7673-40fc-80a0-136ba1d88590]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4" returned: 0 in 0.657s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:46 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 is being set with open permissions: ugo+rw Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:46 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 Apr 16 22:20:46 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:46 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 Apr 16 22:20:46 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:46 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.817s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:46 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Deleted volume successfully. Apr 16 22:20:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a2b0412f-8334-448e-895a-80205dee4d2e tempest-VolumeQuotasAdminTestJSON-1377112102 None] Lock "cinder-91e76cd5-ad8b-4ad7-a9e5-76260c0a3dd5-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:47 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4" returned: 0 in 0.554s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:47 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.info Apr 16 22:20:47 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:47 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741" returned: 0 in 0.811s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:47 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741 Apr 16 22:20:47 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:47 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.info" returned: 0 in 0.491s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:47 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.info is being set with open permissions: ugo+rw Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:47 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.info Apr 16 22:20:47 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:47 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-158833b6-e110-465c-b41a-14c95462c741" returned: 0 in 0.638s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Lock "cinder-quobyte-158833b6-e110-465c-b41a-14c95462c741" released by "delete_volume" :: held 1.501s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:47 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Created reservations ['37e90111-ce23-41a2-b6ac-07d88b01bf93', 'c3a30e45-8b19-4fae-b06e-0806876cea42', 'f9eb2093-b458-494c-aa8f-4acb8a994138', '69bdd21f-58c3-473c-8be3-623b4afa700e'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:48 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.info" returned: 0 in 0.488s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:48 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:48 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.755s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.663s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1327918835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de07c23-cbd8-40a3-8ae0-0c8d60df1040,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:43Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Creating volume 3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:48 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:48 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 1073741824 Apr 16 22:20:48 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1f77098a-4368-4165-8271-c18197f42eb0 tempest-VolumesDeleteCascade-329088807 None] Create snapshot completed successfully Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:48 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.671s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Deleted volume successfully. Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ecc809e2-6a9b-40e3-9f7c-0f55a61f93c7 tempest-VolumesListTestJSON-431524923 None] Lock "cinder-158833b6-e110-465c-b41a-14c95462c741-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "cinder-b74a0f6f-8efa-4a59-832e-82a952af9d91-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Lock "cinder-b74a0f6f-8efa-4a59-832e-82a952af9d91-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:48 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 1073741824" returned: 0 in 0.707s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "cinder-quobyte-b74a0f6f-8efa-4a59-832e-82a952af9d91" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Lock "cinder-quobyte-b74a0f6f-8efa-4a59-832e-82a952af9d91" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1cf5a2-7b41-4208-a19a-1878fa129a69]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:48 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 Apr 16 22:20:48 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:48 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 Apr 16 22:20:48 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:49 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" returned: 0 in 0.547s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.698s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Creating offline snapshot 058100bf-c866-47ba-a71a-9478cf69a3cf of volume d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a25a6df-a24e-4a50-9a19-794aaefae511]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Attempting download of fc1a3fa2-bedc-4143-856a-42ade81658d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}])) to volume 3de07c23-cbd8-40a3-8ae0-0c8d60df1040. {{(pid=82650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7099a88f-235f-41b4-816c-8b7ea70e74bb]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_4c761mpo {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:49 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91" returned: 0 in 0.686s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:49 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 Apr 16 22:20:49 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:49 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91 Apr 16 22:20:49 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:49 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_4c761mpo Apr 16 22:20:49 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:50 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b74a0f6f-8efa-4a59-832e-82a952af9d91" returned: 0 in 0.612s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Lock "cinder-quobyte-b74a0f6f-8efa-4a59-832e-82a952af9d91" released by "delete_volume" :: held 1.337s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:50 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4" returned: 0 in 0.738s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:50 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_4c761mpo" returned: 0 in 0.699s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_4c761mpo {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:50 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf 1G Apr 16 22:20:50 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Created reservations ['2fd4d488-941e-4a03-847a-d8ec5168f9a0', '196b65f4-ae54-443c-8282-cf35d01c2673', 'e0785620-6c58-4e4b-b945-2b28166d4797', '953212d3-5638-4c44-a349-6d399cd5a5f3'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:50 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_4c761mpo Apr 16 22:20:50 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:50 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:50 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:50 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf 1G" returned: 0 in 0.746s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:50 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf Apr 16 22:20:50 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:50 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.716s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:51 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_4c761mpo" returned: 1 in 0.827s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_4c761mpo' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:20:51 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Deleted volume successfully. Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf463ef4-cfb1-4d8e-b63b-942867cb0ec1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-edafa5d4-b707-4159-bda7-aed3a07047d4 tempest-VolumesListTestJSON-431524923 None] Lock "cinder-b74a0f6f-8efa-4a59-832e-82a952af9d91-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:51 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD Apr 16 22:20:51 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:51 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf" returned: 0 in 0.704s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:51 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf is being set with open permissions: ugo+rw Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:51 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf Apr 16 22:20:51 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:51 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD" returned: 0 in 0.695s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] fc1a3fa2-bedc-4143-856a-42ade81658d5 was qcow2, converting to raw {{(pid=82650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 22:20:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:51 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 Apr 16 22:20:51 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Flow 'volume_create_manager' (144dab11-b878-4e0f-8aaa-dcef0910efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dd35f2-950b-4803-9a76-c0940254165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dd35f2-950b-4803-9a76-c0940254165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1790846931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b369c4-874a-42d5-af01-3d332294970d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa60191b80f4ff68b8bc7982a9309ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:52Z,use_quota=True,user_id='cf23764b065846d8a5fdfef340e10261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b276934-c6f4-4cf3-9c7b-b6423309a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b276934-c6f4-4cf3-9c7b-b6423309a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882e9af4-d1cb-4b83-9536-736d3a5f3a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882e9af4-d1cb-4b83-9536-736d3a5f3a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b369c4-874a-42d5-af01-3d332294970d', 'volume_name': 'volume-21b369c4-874a-42d5-af01-3d332294970d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8912f478-18ad-4439-b6f0-4a4d2da6e2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8912f478-18ad-4439-b6f0-4a4d2da6e2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ca7ea5-b323-4e9d-a919-e53acd9bda11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:52 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Volume 21b369c4-874a-42d5-af01-3d332294970d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b369c4-874a-42d5-af01-3d332294970d', 'volume_size': 1} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:52 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf" returned: 0 in 0.766s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.026s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1790846931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b369c4-874a-42d5-af01-3d332294970d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa60191b80f4ff68b8bc7982a9309ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:52Z,use_quota=True,user_id='cf23764b065846d8a5fdfef340e10261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Creating volume 21b369c4-874a-42d5-af01-3d332294970d {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:52 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:52 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2c5b63e5-847e-4f80-9ac3-08ff5b289fbd tempest-VolumesDeleteCascade-329088807 None] Create snapshot completed successfully Apr 16 22:20:52 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d 1073741824 Apr 16 22:20:52 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-d19c8604-0e13-46bb-9c1a-f5c5c07907a4-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-d19c8604-0e13-46bb-9c1a-f5c5c07907a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Performing cascade delete. {{(pid=82650) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-058100bf-c866-47ba-a71a-9478cf69a3cf-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-058100bf-c866-47ba-a71a-9478cf69a3cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-058100bf-c866-47ba-a71a-9478cf69a3cf" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-058100bf-c866-47ba-a71a-9478cf69a3cf" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Deleting offline snapshot 058100bf-c866-47ba-a71a-9478cf69a3cf of volume d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] snapshot_file for this snap is: volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:20:53 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d 1073741824" returned: 0 in 0.718s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7637f91-cec5-467a-8f2d-5526558527b2]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:53 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" returned: 0 in 1.478s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:53 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_z4fyza25devstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:20:53 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:53 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Converted 112.00 MB image at 75.72 MB/s Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:53 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf Apr 16 22:20:53 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:53 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 1G Apr 16 22:20:53 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:53 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d" returned: 0 in 0.609s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:53 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 1G" returned: 0 in 0.588s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ca7ea5-b323-4e9d-a919-e53acd9bda11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b369c4-874a-42d5-af01-3d332294970d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f2979c-beeb-4389-a439-fe1346882528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:53 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Volume volume-21b369c4-874a-42d5-af01-3d332294970d (21b369c4-874a-42d5-af01-3d332294970d): created successfully Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f2979c-beeb-4389-a439-fe1346882528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Flow 'volume_create_manager' (144dab11-b878-4e0f-8aaa-dcef0910efe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[70336011-21cb-4929-bdde-c410662a01e9]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:53 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-317763c0-6a9d-4483-84fb-08332f6ecbe6 tempest-VolumesServicesTestJSON-11988312 None] Created volume successfully. Apr 16 22:20:53 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 Apr 16 22:20:53 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:53 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf" returned: 0 in 0.792s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe7fc8f-4e36-4106-b36a-a0396b844959]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:54 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 Apr 16 22:20:54 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:54 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" returned: 0 in 0.705s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Acquiring lock "cinder-21b369c4-874a-42d5-af01-3d332294970d-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Lock "cinder-21b369c4-874a-42d5-af01-3d332294970d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Acquiring lock "cinder-quobyte-21b369c4-874a-42d5-af01-3d332294970d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Lock "cinder-quobyte-21b369c4-874a-42d5-af01-3d332294970d" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[515e2b98-ac7f-4ada-8972-a3f12dcc05c6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:54 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 Apr 16 22:20:54 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:54 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4" returned: 0 in 0.771s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:20:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:54 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d Apr 16 22:20:54 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:54 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf Apr 16 22:20:54 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:55 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" returned: 1 in 0.729s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Downloaded image fc1a3fa2-bedc-4143-856a-42ade81658d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}])) to volume 3de07c23-cbd8-40a3-8ae0-0c8d60df1040 successfully. {{(pid=82650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Temporary image fc1a3fa2-bedc-4143-856a-42ade81658d5 for user d56fc4c1482a4ae7a2516a0f46b3ec79 is deleted. {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Marking volume 3de07c23-cbd8-40a3-8ae0-0c8d60df1040 as bootable. {{(pid=82650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Copying metadata from image fc1a3fa2-bedc-4143-856a-42ade81658d5 to 3de07c23-cbd8-40a3-8ae0-0c8d60df1040. {{(pid=82650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Creating volume glance metadata for volume 3de07c23-cbd8-40a3-8ae0-0c8d60df1040 backed by image fc1a3fa2-bedc-4143-856a-42ade81658d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 22:20:55 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a20fe5-d3da-457b-9509-f08977960447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0dd62d-7ef4-4dda-8e25-7ac89523235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf" returned: 0 in 0.635s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:55 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Volume volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 (3de07c23-cbd8-40a3-8ae0-0c8d60df1040): created successfully Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0dd62d-7ef4-4dda-8e25-7ac89523235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (940af2ac-27e7-4f87-b55a-4248c596f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:55 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf Apr 16 22:20:55 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ab81a9dc-c61a-4de3-836b-b8083e7bc967 tempest-VolumesGetTest-89660203 None] Created volume successfully. Apr 16 22:20:55 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d" returned: 0 in 0.752s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:55 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d Apr 16 22:20:55 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:55 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.058100bf-c866-47ba-a71a-9478cf69a3cf" returned: 0 in 0.545s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-058100bf-c866-47ba-a71a-9478cf69a3cf" released by "_delete_snapshot" :: held 2.812s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" released by "delete_snapshot" :: held 2.828s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:55 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-21b369c4-874a-42d5-af01-3d332294970d" returned: 0 in 0.547s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Lock "cinder-quobyte-21b369c4-874a-42d5-af01-3d332294970d" released by "delete_volume" :: held 1.325s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Created reservations ['7b035a3d-4106-496d-9b8a-d948b2fe6770', '6fa5a8b1-99e7-4f07-980b-6df637969cb8', '7ced8072-c308-4a21-8f20-a6a93a994f98', '4e2f28ae-8630-4995-af68-c4c963b40516'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Created reservations ['8153f807-a2e4-4dae-8e2d-412289b54260', '4436f380-9a36-4096-b8da-b6d39a447b0c', 'f8fe53a2-53f8-4ad1-b114-2c70acd72d4c', 'a0fd116f-7410-43ad-a647-ff908f0537eb'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:20:56 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Delete snapshot completed successfully. Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-058100bf-c866-47ba-a71a-9478cf69a3cf-delete_snapshot" released by "delete_snapshot" :: held 3.003s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-d6abc8b6-c6cb-47f4-88e2-14d757f597b4-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-d6abc8b6-c6cb-47f4-88e2-14d757f597b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:56 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:20:56 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-d6abc8b6-c6cb-47f4-88e2-14d757f597b4" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-d6abc8b6-c6cb-47f4-88e2-14d757f597b4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Deleting offline snapshot d6abc8b6-c6cb-47f4-88e2-14d757f597b4 of volume d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] snapshot_file for this snap is: volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[36130924-da2b-4024-9351-0e1039fd2e50]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:56 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 Apr 16 22:20:56 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:56 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.750s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:20:56 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Deleted volume successfully. Apr 16 22:20:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-657e1725-0950-470f-a6cb-e63fde237d48 tempest-VolumesServicesTestJSON-11988312 None] Lock "cinder-21b369c4-874a-42d5-af01-3d332294970d-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (b31c1987-cffe-446d-aa2c-b2c8165a8c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59db70d-343a-4666-82bf-5941d4289beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59db70d-343a-4666-82bf-5941d4289beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-820183784',display_name='tempest-VolumesGetTest-Volume-1961357095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854dd416-fb9b-494b-bf01-48ee01e5dfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:57Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9975912f-9c1f-4b44-a998-342d4d1fff79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9975912f-9c1f-4b44-a998-342d4d1fff79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee0a457-b790-4772-ad38-9dd29e82cc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee0a457-b790-4772-ad38-9dd29e82cc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '854dd416-fb9b-494b-bf01-48ee01e5dfe0', 'volume_name': 'volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ebaa5f-94c0-449d-b7b2-763e4c8749ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ebaa5f-94c0-449d-b7b2-763e4c8749ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15608d82-c722-431f-b109-47cb7f04cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:57 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Volume 854dd416-fb9b-494b-bf01-48ee01e5dfe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0', 'volume_size': 1} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:20:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-820183784',display_name='tempest-VolumesGetTest-Volume-1961357095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854dd416-fb9b-494b-bf01-48ee01e5dfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec3bc3039c4bad8a1b1d1cc330380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:20:57Z,use_quota=True,user_id='d56fc4c1482a4ae7a2516a0f46b3ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Creating volume 854dd416-fb9b-494b-bf01-48ee01e5dfe0 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:20:57 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:57 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 1073741824 Apr 16 22:20:57 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:57 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4" returned: 0 in 1.010s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe14112-09d7-432d-bd79-1b42f6571a1b]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:57 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 Apr 16 22:20:57 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:58 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 1073741824" returned: 0 in 1.092s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:58 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:58 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 Apr 16 22:20:58 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" returned: 0 in 1.109s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:58 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 Apr 16 22:20:58 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:59 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0" returned: 0 in 0.741s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15608d82-c722-431f-b109-47cb7f04cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f19f04-2f49-4cac-9b6a-6d34a2e2c621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:20:59 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Volume volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 (854dd416-fb9b-494b-bf01-48ee01e5dfe0): created successfully Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f19f04-2f49-4cac-9b6a-6d34a2e2c621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Flow 'volume_create_manager' (b31c1987-cffe-446d-aa2c-b2c8165a8c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:20:59 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-96d66eaa-001e-4323-b058-a3b224f88ee1 tempest-VolumesGetTest-89660203 None] Created volume successfully. Apr 16 22:20:59 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4" returned: 0 in 0.877s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:59 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4 Apr 16 22:20:59 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-854dd416-fb9b-494b-bf01-48ee01e5dfe0-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Lock "cinder-854dd416-fb9b-494b-bf01-48ee01e5dfe0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-854dd416-fb9b-494b-bf01-48ee01e5dfe0" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-854dd416-fb9b-494b-bf01-48ee01e5dfe0" acquired by "delete_volume" :: waited 0.026s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a614d9-2d0b-4008-8a78-1975c6b99af3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:20:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:20:59 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 Apr 16 22:20:59 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:00 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4.d6abc8b6-c6cb-47f4-88e2-14d757f597b4" returned: 0 in 1.030s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-d6abc8b6-c6cb-47f4-88e2-14d757f597b4" released by "_delete_snapshot" :: held 4.112s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" released by "delete_snapshot" :: held 4.131s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Created reservations ['349f3e5d-408a-4b44-ab5d-86f71ae133e0', '8629c146-0d43-429f-a0be-f1c6976bd885', 'a4d8d29c-b64d-41b0-bff6-6e6aabec47c7', 'f5b9b8f6-a065-48df-87d7-fe332463baaa'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:00 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Delete snapshot completed successfully. Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-d6abc8b6-c6cb-47f4-88e2-14d757f597b4-delete_snapshot" released by "delete_snapshot" :: held 4.379s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Snapshots deleted, issuing volume delete {{(pid=82650) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" acquired by "delete_volume" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:00 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0" returned: 0 in 0.858s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fcdded-3b1b-42c3-acf2-02feaca1f952]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:00 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0 Apr 16 22:21:00 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:00 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 Apr 16 22:21:00 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:01 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-854dd416-fb9b-494b-bf01-48ee01e5dfe0" returned: 0 in 0.693s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-854dd416-fb9b-494b-bf01-48ee01e5dfe0" released by "delete_volume" :: held 1.591s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:01 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" returned: 0 in 0.716s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Created reservations ['36c0c1ce-4f0c-482d-bf21-9a75ec194d4d', '22af3ff3-9a8b-4be2-8555-ccccb91ae141', '1057ac45-cbea-4fee-92ce-6a8241f354f9', 'dc2f237c-6192-481c-acfb-9874739ebe06'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:01 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4 Apr 16 22:21:01 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:01 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:01 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-3de07c23-cbd8-40a3-8ae0-0c8d60df1040-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Lock "cinder-3de07c23-cbd8-40a3-8ae0-0c8d60df1040-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Acquiring lock "cinder-quobyte-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498f79e-c006-4b11-9e74-0431bdf78325]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:02 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.656s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Deleted volume successfully. Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cf9bacf3-34db-4cd0-a971-b1e8dffc4a7f tempest-VolumesGetTest-89660203 None] Lock "cinder-854dd416-fb9b-494b-bf01-48ee01e5dfe0-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:02 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 Apr 16 22:21:02 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:02 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" returned: 0 in 0.955s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-d19c8604-0e13-46bb-9c1a-f5c5c07907a4" released by "delete_volume" :: held 1.752s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Created reservations ['dd2bd2fb-ff18-4735-b2f3-abba91269e47', '49b071a2-1284-4ba3-afc3-86428a4e1d27', '5781dde4-d8b9-4204-a486-88ffd7b996c1', '1020b5b3-0840-4f97-9c6c-d058680f3352'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:02 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:02 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:02 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" returned: 0 in 0.813s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:02 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 Apr 16 22:21:03 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:03 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.023s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:03 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Deleted volume successfully. Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f71caacf-f91d-4016-a13a-dea5053faa5b tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-d19c8604-0e13-46bb-9c1a-f5c5c07907a4-delete_volume" released by "delete_volume" :: held 10.433s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Flow 'volume_create_manager' (d3a822c3-d4dd-4b36-8410-4fe6d0d3b656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029fca87-c4e6-413e-b39b-113d96a8e56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029fca87-c4e6-413e-b39b-113d96a8e56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1215955288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478c81a4-1bf6-41f3-acc0-ffbd6a50815f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5238926d66f4667abeda922deec5a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:04Z,use_quota=True,user_id='b336a687e1f348cfbda8ad9ddbc45272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c839a24-f5ce-4cd7-a97f-cfc9cec28aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c839a24-f5ce-4cd7-a97f-cfc9cec28aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90f1c81-e825-46e7-b489-4b55cdf9e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90f1c81-e825-46e7-b489-4b55cdf9e500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478c81a4-1bf6-41f3-acc0-ffbd6a50815f', 'volume_name': 'volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ced78a-41ca-49b0-914d-6a1f8b8ab043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ced78a-41ca-49b0-914d-6a1f8b8ab043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:03 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40b8674-d645-4edd-a648-f74be8ae21b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:03 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Volume 478c81a4-1bf6-41f3-acc0-ffbd6a50815f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f', 'volume_size': 1} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1215955288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478c81a4-1bf6-41f3-acc0-ffbd6a50815f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5238926d66f4667abeda922deec5a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:04Z,use_quota=True,user_id='b336a687e1f348cfbda8ad9ddbc45272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Creating volume 478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:03 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" returned: 1 in 0.966s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:21:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:03 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f 1073741824 Apr 16 22:21:03 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:03 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040 Apr 16 22:21:03 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:04 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" returned: 0 in 0.506s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Lock "cinder-quobyte-3de07c23-cbd8-40a3-8ae0-0c8d60df1040" released by "delete_volume" :: held 2.388s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (06ed0de6-61d5-4f38-a847-d7cbd206e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce73cfd0-cc9c-4042-ab75-ebb6b2aca805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce73cfd0-cc9c-4042-ab75-ebb6b2aca805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1815171511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bad2c4-babe-43d0-a3cb-a1947a992d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3334dd33ffd94bdbae70481e2774029f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:04Z,use_quota=True,user_id='9d4073bf3b684303924d2f120d68cd7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7aedfb-d024-4c7f-b3c0-064e77db58ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7aedfb-d024-4c7f-b3c0-064e77db58ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10fa15e-f124-47dd-9dd2-f29c47f9845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10fa15e-f124-47dd-9dd2-f29c47f9845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99bad2c4-babe-43d0-a3cb-a1947a992d6c', 'volume_name': 'volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e629548-a8b8-492d-b9b9-549297986d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e629548-a8b8-492d-b9b9-549297986d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6995d62e-3c5d-4cc3-82ca-588e086ee230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:04 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Volume 99bad2c4-babe-43d0-a3cb-a1947a992d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c', 'volume_size': 1} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Created reservations ['a8158a49-1e74-404f-a652-79471a226ae3', 'ad5956c6-0bd8-4224-822c-c7dc4a1b1a65', '2f691b29-789b-4a3a-8cb4-1f461a4a5c8e', '35962ff5-20c2-4fab-94a7-2adb615c476b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:04 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:04 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:04 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f 1073741824" returned: 0 in 0.844s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:04 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f Apr 16 22:21:04 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:05 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.669s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Deleted volume successfully. Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d31226a-2725-41f4-a33a-66dfa2fd1f43 tempest-VolumesGetTest-89660203 None] Lock "cinder-3de07c23-cbd8-40a3-8ae0-0c8d60df1040-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:05 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" returned: 0 in 0.679s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.886s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1815171511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bad2c4-babe-43d0-a3cb-a1947a992d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3334dd33ffd94bdbae70481e2774029f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:04Z,use_quota=True,user_id='9d4073bf3b684303924d2f120d68cd7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Creating volume 99bad2c4-babe-43d0-a3cb-a1947a992d6c {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:05 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40b8674-d645-4edd-a648-f74be8ae21b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352bbfff-73e3-4123-9a2d-c9288f59333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:05 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c 1073741824 Apr 16 22:21:05 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:05 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Volume volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f (478c81a4-1bf6-41f3-acc0-ffbd6a50815f): created successfully Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352bbfff-73e3-4123-9a2d-c9288f59333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Flow 'volume_create_manager' (d3a822c3-d4dd-4b36-8410-4fe6d0d3b656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b57a8627-f3d8-4866-b480-9404a3ee4411 tempest-VolumesDeleteCascade-329088807 None] Created volume successfully. Apr 16 22:21:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:06 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c 1073741824" returned: 0 in 0.939s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:06 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c Apr 16 22:21:06 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:07 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c" returned: 0 in 0.748s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.929s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Creating offline snapshot 443d2dee-e0a7-4097-9057-deb7bdd653ed of volume 478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6995d62e-3c5d-4cc3-82ca-588e086ee230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0938bd52-3bf5-499d-b627-fdedf4c04692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b88a62-8707-440c-83aa-93727d21bff3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:07 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Volume volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c (99bad2c4-babe-43d0-a3cb-a1947a992d6c): created successfully Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0938bd52-3bf5-499d-b627-fdedf4c04692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (06ed0de6-61d5-4f38-a847-d7cbd206e180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:07 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-89103e8c-a51c-45d6-b44d-702254f48146 tempest-VolumesSnapshotTestJSON-479772322 None] Created volume successfully. Apr 16 22:21:07 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f Apr 16 22:21:07 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:08 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" returned: 0 in 0.920s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:08 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed 1G Apr 16 22:21:08 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Flow 'volume_create_manager' (0dd3cfd4-74b2-4e23-8cc1-d9200ed55011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb424ef-3c23-492e-87e6-b1d34e576fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb424ef-3c23-492e-87e6-b1d34e576fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1050464558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9256c22-8e7c-4f79-bf1a-9cc63c3a380d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e89d77837044479816e0b8fe8094001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:08Z,use_quota=True,user_id='bcfdf044980041d5a4e82544d540adc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c09ede-db88-4c7d-a740-20a9ff4f256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c09ede-db88-4c7d-a740-20a9ff4f256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014b3fd9-8616-4c65-8f58-414b97c4aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014b3fd9-8616-4c65-8f58-414b97c4aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9256c22-8e7c-4f79-bf1a-9cc63c3a380d', 'volume_name': 'volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511a948b-4a83-4891-8e35-5bf4c7402fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511a948b-4a83-4891-8e35-5bf4c7402fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6847c99e-7203-44d2-926e-3cbbb37a9761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:08 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Volume a9256c22-8e7c-4f79-bf1a-9cc63c3a380d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d', 'volume_size': 1} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:08 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed 1G" returned: 0 in 0.810s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:08 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed Apr 16 22:21:08 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:09 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed" returned: 0 in 0.619s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:09 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed is being set with open permissions: ugo+rw Apr 16 22:21:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:09 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed Apr 16 22:21:09 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:10 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed" returned: 0 in 0.570s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:10 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.info Apr 16 22:21:10 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:10 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.info" returned: 0 in 0.578s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:10 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.info is being set with open permissions: ugo+rw Apr 16 22:21:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:10 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.info Apr 16 22:21:10 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:11 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.info" returned: 0 in 0.542s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.152s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.367s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Creating offline snapshot 1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed of volume 99bad2c4-babe-43d0-a3cb-a1947a992d6c {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:21:11 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4430d6-f2a7-4d68-8a0e-84d490d75706]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-000f11b2-81df-4b85-a5da-3546427ab499 tempest-VolumesDeleteCascade-329088807 None] Create snapshot completed successfully Apr 16 22:21:11 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c Apr 16 22:21:11 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:11 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c" returned: 0 in 0.667s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:12 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed 1G Apr 16 22:21:12 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:12 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed 1G" returned: 0 in 0.744s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:12 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed Apr 16 22:21:12 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Flow 'volume_create_manager' (adfbc8ee-dd4a-450c-815e-349d94cd0830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cf2f0c-a080-4b42-9831-622d78ce4088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cf2f0c-a080-4b42-9831-622d78ce4088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-477917203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6cdecc-e831-4282-bf3d-a3759b910056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5238926d66f4667abeda922deec5a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=443d2dee-e0a7-4097-9057-deb7bdd653ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:13Z,use_quota=True,user_id='b336a687e1f348cfbda8ad9ddbc45272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66449b82-655b-43aa-9d41-236d6ebee484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66449b82-655b-43aa-9d41-236d6ebee484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e6a043-0606-4c97-8e84-8c6a4abfbd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e6a043-0606-4c97-8e84-8c6a4abfbd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e6cdecc-e831-4282-bf3d-a3759b910056', 'volume_name': 'volume-1e6cdecc-e831-4282-bf3d-a3759b910056', 'volume_size': 1, 'snapshot_id': '443d2dee-e0a7-4097-9057-deb7bdd653ed'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d491938-024b-4c64-bfb1-021b89a2f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d491938-024b-4c64-bfb1-021b89a2f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ee2131-70f4-47ef-a9ad-552e25c5520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:12 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Volume 1e6cdecc-e831-4282-bf3d-a3759b910056: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e6cdecc-e831-4282-bf3d-a3759b910056', 'volume_size': 1, 'snapshot_id': '443d2dee-e0a7-4097-9057-deb7bdd653ed'} Apr 16 22:21:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:13 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed" returned: 0 in 0.729s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:13 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed is being set with open permissions: ugo+rw Apr 16 22:21:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:13 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed Apr 16 22:21:13 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:14 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed" returned: 0 in 0.618s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:14 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.info Apr 16 22:21:14 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:14 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.info" returned: 0 in 0.613s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:14 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.info is being set with open permissions: ugo+rw Apr 16 22:21:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:14 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.info Apr 16 22:21:14 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:15 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.info" returned: 0 in 0.532s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.996s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.711s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1050464558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9256c22-8e7c-4f79-bf1a-9cc63c3a380d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e89d77837044479816e0b8fe8094001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:08Z,use_quota=True,user_id='bcfdf044980041d5a4e82544d540adc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Creating volume a9256c22-8e7c-4f79-bf1a-9cc63c3a380d {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:15 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:15 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d 1073741824 Apr 16 22:21:15 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:15 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f274d001-5cd3-4e02-beb1-d058e86be22d tempest-VolumesSnapshotTestJSON-479772322 None] Create snapshot completed successfully Apr 16 22:21:15 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d 1073741824" returned: 0 in 0.656s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:16 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d Apr 16 22:21:16 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:16 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d" returned: 0 in 0.516s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.550s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-443d2dee-e0a7-4097-9057-deb7bdd653ed-1e6cdecc-e831-4282-bf3d-a3759b910056" by "_create_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6847c99e-7203-44d2-926e-3cbbb37a9761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcab9cd8-00bd-48dd-93f4-0821740a3812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-443d2dee-e0a7-4097-9057-deb7bdd653ed-1e6cdecc-e831-4282-bf3d-a3759b910056" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Creating volume 1e6cdecc-e831-4282-bf3d-a3759b910056 from snapshot 443d2dee-e0a7-4097-9057-deb7bdd653ed {{(pid=82650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-1e6cdecc-e831-4282-bf3d-a3759b910056" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:16 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Volume volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d (a9256c22-8e7c-4f79-bf1a-9cc63c3a380d): created successfully Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcab9cd8-00bd-48dd-93f4-0821740a3812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Flow 'volume_create_manager' (0dd3cfd4-74b2-4e23-8cc1-d9200ed55011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-1e6cdecc-e831-4282-bf3d-a3759b910056" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] snapshot: 443d2dee-e0a7-4097-9057-deb7bdd653ed, volume: 1e6cdecc-e831-4282-bf3d-a3759b910056, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:21:16 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6c10522c-cc12-40bd-8c28-0cab23018063 tempest-VolumesTransfersTest-1252525104 None] Created volume successfully. Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-99bad2c4-babe-43d0-a3cb-a1947a992d6c" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-99bad2c4-babe-43d0-a3cb-a1947a992d6c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1406f67e-7500-4ce9-953b-67d77a25d861]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Deleting offline snapshot 1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed of volume 99bad2c4-babe-43d0-a3cb-a1947a992d6c {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] snapshot_file for this snap is: volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5947e18-165e-405e-912b-1c8b21151e96]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:16 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed Apr 16 22:21:16 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:16 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed Apr 16 22:21:16 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:17 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed" returned: 0 in 0.708s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[26283f96-d780-4496-b0c4-a7a57d384013]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:17 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed" returned: 0 in 0.740s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b813bd-0308-4b39-a582-fd8ebab7b47d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:17 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f Apr 16 22:21:17 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:17 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c Apr 16 22:21:17 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:17 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e50968e9-8d03-4d47-ae62-a50759d869a8 tempest-VolumesTransfersTest-457826708 None] Transfer volume completed successfully. Apr 16 22:21:18 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" returned: 0 in 0.717s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:18 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 Apr 16 22:21:18 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:18 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c" returned: 0 in 0.706s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:18 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed Apr 16 22:21:18 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:18 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed" returned: 0 in 0.671s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:18 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed Apr 16 22:21:18 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Acquiring lock "cinder-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Lock "cinder-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Acquiring lock "cinder-quobyte-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Lock "cinder-quobyte-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d" acquired by "delete_volume" :: waited 0.032s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:19 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4e0fde-2844-4888-b0db-924ccec881ef]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:19 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d Apr 16 22:21:19 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:20 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c.1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed" returned: 0 in 2.104s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed" released by "_delete_snapshot" :: held 4.335s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-99bad2c4-babe-43d0-a3cb-a1947a992d6c" released by "delete_snapshot" :: held 4.367s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Created reservations ['988793cf-4c7f-49c0-969f-b46de4b70ae8', 'd4f42473-75db-4c9c-a758-f4572f5f90bf', '4a191711-895b-4b8f-830d-b09d8e23be4a', '08237e2e-db98-4592-9237-4c0beca0442a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:21 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Delete snapshot completed successfully. Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ab7e1345-b65d-4351-aa04-d57a0c2528d6 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-1c1c5a8e-57d8-4fbd-b0d7-296ba35557ed-delete_snapshot" released by "delete_snapshot" :: held 4.840s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:21 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d" returned: 0 in 2.273s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:21 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056" returned: 0 in 3.327s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[220e3336-874e-4049-986e-8f11c335a282]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:21 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d Apr 16 22:21:21 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:21 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f Apr 16 22:21:21 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:21 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d" returned: 0 in 0.545s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Lock "cinder-quobyte-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d" released by "delete_volume" :: held 2.913s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:21 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Created reservations ['7d6e38ec-971b-4270-b753-eda5db30bf02', 'fd6f2b3b-ffad-4783-a76f-a8ea6a4eb295', '9c65c778-bfeb-4974-846e-f4f1da6a4fb1', '9aec650b-7b39-4334-9c75-e7b5b014697e'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:22 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:22 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:22 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" returned: 0 in 0.888s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f, size 1024.00 MB, duration 3.33 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:21:22 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Converted 1024.00 MB image at 307.57 MB/s Apr 16 22:21:22 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 is being set with open permissions: ugo+rw Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:22 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 Apr 16 22:21:22 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (f5b863fd-90f3-4beb-abd5-542948f54083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4314c19-a956-4310-8deb-2bc78e0cc9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4314c19-a956-4310-8deb-2bc78e0cc9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-952636970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4457392e-a7af-496c-84be-d75a8d7051df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3334dd33ffd94bdbae70481e2774029f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:22Z,use_quota=True,user_id='9d4073bf3b684303924d2f120d68cd7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e385cd-3969-4eaf-95ff-4a9064b0b0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e385cd-3969-4eaf-95ff-4a9064b0b0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c790dbcf-e9da-45e7-a4e9-0a401ec1caed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c790dbcf-e9da-45e7-a4e9-0a401ec1caed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4457392e-a7af-496c-84be-d75a8d7051df', 'volume_name': 'volume-4457392e-a7af-496c-84be-d75a8d7051df', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985baf12-bb5b-4a73-8392-9a1f9b2aaab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985baf12-bb5b-4a73-8392-9a1f9b2aaab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fec674-4e88-4786-842e-243d82632bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Volume 4457392e-a7af-496c-84be-d75a8d7051df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4457392e-a7af-496c-84be-d75a8d7051df', 'volume_size': 1} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Flow 'volume_create_manager' (8e61d415-cf90-41a2-a13d-98be745570fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d10d5e-c421-4b32-8b0e-11034c4e86ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d10d5e-c421-4b32-8b0e-11034c4e86ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2050762655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840727ff-b893-43ee-8855-8426492a1e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e89d77837044479816e0b8fe8094001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:23Z,use_quota=True,user_id='bcfdf044980041d5a4e82544d540adc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9da6750-e2f3-406d-8c63-069798efa710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9da6750-e2f3-406d-8c63-069798efa710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a86ba38-1cbb-4446-ad68-45d016ae44f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a86ba38-1cbb-4446-ad68-45d016ae44f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840727ff-b893-43ee-8855-8426492a1e40', 'volume_name': 'volume-840727ff-b893-43ee-8855-8426492a1e40', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a51aff-b70c-43b6-898a-b9463f4c8410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a51aff-b70c-43b6-898a-b9463f4c8410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:22 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3dbe810-bdd2-40d5-ba56-ad8e0ad41fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:23 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Volume 840727ff-b893-43ee-8855-8426492a1e40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840727ff-b893-43ee-8855-8426492a1e40', 'volume_size': 1} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:23 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.966s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Deleted volume successfully. Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-210a4f09-318a-440f-a151-dc5d6f99a14b tempest-VolumesTransfersTest-441929805 None] Lock "cinder-a9256c22-8e7c-4f79-bf1a-9cc63c3a380d-delete_volume" released by "delete_volume" :: held 4.126s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:23 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056" returned: 0 in 0.847s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-1e6cdecc-e831-4282-bf3d-a3759b910056" released by "_copy_volume_from_snapshot" :: held 6.584s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-443d2dee-e0a7-4097-9057-deb7bdd653ed-1e6cdecc-e831-4282-bf3d-a3759b910056" released by "_create_volume_from_snapshot" :: held 6.626s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.664s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-952636970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4457392e-a7af-496c-84be-d75a8d7051df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3334dd33ffd94bdbae70481e2774029f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:22Z,use_quota=True,user_id='9d4073bf3b684303924d2f120d68cd7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Creating volume 4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:23 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:UPDATE=192,cinder:SELECT=148,cinder:INSERT=40,cinder:DELETE=10 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:21:23 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df 1073741824 Apr 16 22:21:23 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ee2131-70f4-47ef-a9ad-552e25c5520e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6cdecc-e831-4282-bf3d-a3759b910056', 'volume_size': 1, 'snapshot_id': '443d2dee-e0a7-4097-9057-deb7bdd653ed'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744a4233-3d1e-4b29-85e2-d771ada95ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:23 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Volume volume-1e6cdecc-e831-4282-bf3d-a3759b910056 (1e6cdecc-e831-4282-bf3d-a3759b910056): created successfully Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744a4233-3d1e-4b29-85e2-d771ada95ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Flow 'volume_create_manager' (adfbc8ee-dd4a-450c-815e-349d94cd0830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6ff84205-728b-430e-abd2-aa4c9e9d4148 tempest-VolumesDeleteCascade-329088807 None] Created volume successfully. Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-478c81a4-1bf6-41f3-acc0-ffbd6a50815f-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-478c81a4-1bf6-41f3-acc0-ffbd6a50815f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:24 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df 1073741824" returned: 0 in 0.821s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Performing cascade delete. {{(pid=82650) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-443d2dee-e0a7-4097-9057-deb7bdd653ed-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:24 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df Apr 16 22:21:24 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-443d2dee-e0a7-4097-9057-deb7bdd653ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-443d2dee-e0a7-4097-9057-deb7bdd653ed" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-443d2dee-e0a7-4097-9057-deb7bdd653ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Deleting offline snapshot 443d2dee-e0a7-4097-9057-deb7bdd653ed of volume 478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] snapshot_file for this snap is: volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c3659f-bafb-4dc2-baef-16cffc977d22]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:24 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed Apr 16 22:21:24 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:24 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:24 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:24 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df" returned: 0 in 0.810s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.895s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2050762655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840727ff-b893-43ee-8855-8426492a1e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e89d77837044479816e0b8fe8094001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:23Z,use_quota=True,user_id='bcfdf044980041d5a4e82544d540adc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Creating volume 840727ff-b893-43ee-8855-8426492a1e40 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:24 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fec674-4e88-4786-842e-243d82632bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4457392e-a7af-496c-84be-d75a8d7051df', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7343619d-472e-4713-bcbe-05d459081816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:24 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Volume volume-4457392e-a7af-496c-84be-d75a8d7051df (4457392e-a7af-496c-84be-d75a8d7051df): created successfully Apr 16 22:21:24 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 1073741824 Apr 16 22:21:24 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7343619d-472e-4713-bcbe-05d459081816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (f5b863fd-90f3-4beb-abd5-542948f54083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:25 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4fb792ba-a90b-4b37-ba7f-8a15bf90a9a7 tempest-VolumesSnapshotTestJSON-479772322 None] Created volume successfully. Apr 16 22:21:25 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.763s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:21:25 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed" returned: 0 in 1.060s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e551da2-46b1-4b37-b5e1-edf21e762574]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:25 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f Apr 16 22:21:25 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:25 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 1073741824" returned: 0 in 0.814s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:25 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 Apr 16 22:21:25 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:25 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" returned: 0 in 0.605s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:25 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed Apr 16 22:21:25 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:26 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40" returned: 0 in 0.711s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.623s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3dbe810-bdd2-40d5-ba56-ad8e0ad41fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840727ff-b893-43ee-8855-8426492a1e40', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c73105-4ab1-4ef6-9419-5643b1db6aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:26 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Creating offline snapshot 85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 of volume 4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed" returned: 0 in 0.648s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e8aa47-f5b9-44e9-9a1c-171b4c7698d1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:26 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Volume volume-840727ff-b893-43ee-8855-8426492a1e40 (840727ff-b893-43ee-8855-8426492a1e40): created successfully Apr 16 22:21:26 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed Apr 16 22:21:26 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c73105-4ab1-4ef6-9419-5643b1db6aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:26 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Flow 'volume_create_manager' (8e61d415-cf90-41a2-a13d-98be745570fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:26 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a6a19420-038f-4f1e-83ad-8e4cf828bdac tempest-VolumesTransfersTest-1252525104 None] Created volume successfully. Apr 16 22:21:26 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df Apr 16 22:21:26 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:27 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f.443d2dee-e0a7-4097-9057-deb7bdd653ed" returned: 0 in 0.569s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-443d2dee-e0a7-4097-9057-deb7bdd653ed" released by "_delete_snapshot" :: held 2.947s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" released by "delete_snapshot" :: held 2.968s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Created reservations ['f017b0c3-869e-48b2-9520-ba7e48429204', '88a5168d-f26e-4cc6-a083-b01c7937cd16', 'e524f359-32ea-478c-b2e9-df8fa128c005', 'a7f2e17d-4a51-4dca-be1f-97627d7e998c'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Delete snapshot completed successfully. Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-443d2dee-e0a7-4097-9057-deb7bdd653ed-delete_snapshot" released by "delete_snapshot" :: held 3.134s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Snapshots deleted, issuing volume delete {{(pid=82650) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e693e4-2c3a-4762-baac-fe6ca55b0c13]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:27 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df" returned: 0 in 0.760s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:27 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 1G Apr 16 22:21:27 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:27 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f Apr 16 22:21:27 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Acquiring lock "cinder-840727ff-b893-43ee-8855-8426492a1e40-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Lock "cinder-840727ff-b893-43ee-8855-8426492a1e40-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Acquiring lock "cinder-quobyte-840727ff-b893-43ee-8855-8426492a1e40" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Lock "cinder-quobyte-840727ff-b893-43ee-8855-8426492a1e40" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[030c81e7-2d87-44d0-97ff-09f718648b6b]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:27 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 Apr 16 22:21:27 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:27 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" returned: 0 in 0.640s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:27 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f Apr 16 22:21:27 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:28 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 1G" returned: 0 in 0.744s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4457392e-a7af-496c-84be-d75a8d7051df -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:28 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4457392e-a7af-496c-84be-d75a8d7051df -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 Apr 16 22:21:28 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:28 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40" returned: 0 in 0.819s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:28 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40 Apr 16 22:21:28 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:28 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" returned: 0 in 0.636s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-478c81a4-1bf6-41f3-acc0-ffbd6a50815f" released by "delete_volume" :: held 1.317s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Created reservations ['3e5ea4d2-b67d-444f-b281-3895a0572177', '80cf7c4d-203f-4a0e-a5ec-804fabab2390', '4f2857cc-54cc-4cf9-8ec9-548a7b943910', '3b240e8b-42d5-4888-9726-c3b3c895974b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:28 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:28 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:28 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4457392e-a7af-496c-84be-d75a8d7051df -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" returned: 0 in 0.829s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:28 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 is being set with open permissions: ugo+rw Apr 16 22:21:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:28 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 Apr 16 22:21:28 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:29 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-840727ff-b893-43ee-8855-8426492a1e40" returned: 0 in 0.653s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Lock "cinder-quobyte-840727ff-b893-43ee-8855-8426492a1e40" released by "delete_volume" :: held 1.502s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Created reservations ['266f7985-7de2-4f9a-9cd3-4503b0d37206', '9d05b7e4-8ac6-4c76-ae04-6a683410a7e4', 'afcfd3fb-b45f-41c7-8f19-0b1db684202f', '1790d20f-3f24-40e8-aba7-8ecdf1927209'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:29 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:29 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:29 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.820s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:29 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Deleted volume successfully. Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d2eb588a-5d4a-4b55-9aa3-aa0c2b28fd11 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-478c81a4-1bf6-41f3-acc0-ffbd6a50815f-delete_volume" released by "delete_volume" :: held 5.528s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-1e6cdecc-e831-4282-bf3d-a3759b910056-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-1e6cdecc-e831-4282-bf3d-a3759b910056-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:29 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "cinder-quobyte-1e6cdecc-e831-4282-bf3d-a3759b910056" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" returned: 0 in 0.905s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-1e6cdecc-e831-4282-bf3d-a3759b910056" acquired by "delete_volume" :: waited 0.025s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d6b670-4288-4dbb-aa71-7b8da6ca6655]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:29 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.info Apr 16 22:21:29 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:30 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.773s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:30 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Deleted volume successfully. Apr 16 22:21:30 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 Apr 16 22:21:30 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:UPDATE=205,cinder:SELECT=162,cinder:DELETE=27,cinder:INSERT=63 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7c1d51d5-8c95-4258-85d0-6ae1370acfec tempest-VolumesTransfersTest-441929805 None] Lock "cinder-840727ff-b893-43ee-8855-8426492a1e40-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:30 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.info" returned: 0 in 0.589s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:30 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.info is being set with open permissions: ugo+rw Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:30 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.info Apr 16 22:21:30 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:30 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056" returned: 0 in 0.809s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:30 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056 Apr 16 22:21:30 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Flow 'volume_create_manager' (07513282-ed77-48ef-8a74-ab90be7f2af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e89b061-82e3-4742-841d-1d59f5ad2cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e89b061-82e3-4742-841d-1d59f5ad2cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-64403816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248b7c6e-16e6-433b-8d44-a6b72e8f50e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5187d93e08e5435587c483e03681199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:31Z,use_quota=True,user_id='a01c8cfec1d44dad9959c2cd519c7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add84fc1-ce09-45cb-9250-7e310a51b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add84fc1-ce09-45cb-9250-7e310a51b06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a939029-3ca0-45b9-b8c1-df8e2aaacd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a939029-3ca0-45b9-b8c1-df8e2aaacd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '248b7c6e-16e6-433b-8d44-a6b72e8f50e9', 'volume_name': 'volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd57d768-39b3-42d5-ab63-cab320c550e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd57d768-39b3-42d5-ab63-cab320c550e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330d7022-35ad-435c-b061-35a22fc40faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:30 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Volume 248b7c6e-16e6-433b-8d44-a6b72e8f50e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9', 'volume_size': 1} Apr 16 22:21:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:31 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.info" returned: 0 in 0.582s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.601s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-64403816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248b7c6e-16e6-433b-8d44-a6b72e8f50e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5187d93e08e5435587c483e03681199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:31Z,use_quota=True,user_id='a01c8cfec1d44dad9959c2cd519c7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Creating volume 248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:31 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:31 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-21f5fa83-73bd-4e81-9590-216eb70a4ebe tempest-VolumesSnapshotTestJSON-479772322 None] Create snapshot completed successfully Apr 16 22:21:31 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 1073741824 Apr 16 22:21:31 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:31 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1e6cdecc-e831-4282-bf3d-a3759b910056" returned: 0 in 0.589s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-quobyte-1e6cdecc-e831-4282-bf3d-a3759b910056" released by "delete_volume" :: held 1.458s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Created reservations ['adc4d484-343a-4c88-a0c6-43d9fd7067b2', 'b8f88c1e-4e73-4f2b-94b8-028281dd4914', '63611a5f-971b-4c5d-9abb-025f78ed36ee', '576364d6-ae5e-4782-8d52-3f27ac722854'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:31 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:31 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:31 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 1073741824" returned: 0 in 0.795s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:31 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 Apr 16 22:21:31 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:32 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.812s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:32 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Deleted volume successfully. Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cbcef785-cdcf-4246-8eba-d9c3f1ec5583 tempest-VolumesDeleteCascade-329088807 None] Lock "cinder-1e6cdecc-e831-4282-bf3d-a3759b910056-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:32 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" returned: 0 in 0.697s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330d7022-35ad-435c-b061-35a22fc40faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c2e288-ae24-4ec2-bc71-7676c9f29557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Volume volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 (248b7c6e-16e6-433b-8d44-a6b72e8f50e9): created successfully Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c2e288-ae24-4ec2-bc71-7676c9f29557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Flow 'volume_create_manager' (07513282-ed77-48ef-8a74-ab90be7f2af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:32 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e8a66aa9-c510-41d4-b281-52b32cf5b682 tempest-SnapshotDependencyTests-1659159319 None] Created volume successfully. Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (a2fb1876-655d-421e-8909-774baf0e6a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5563a93d-5277-4752-a6e0-fd9a81a362c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5563a93d-5277-4752-a6e0-fd9a81a362c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1159506087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca37d16e-304b-4830-8e57-6f64b2df5c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3334dd33ffd94bdbae70481e2774029f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=85a98ffa-dc56-4eb5-89fa-12bd0ad67df8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:33Z,use_quota=True,user_id='9d4073bf3b684303924d2f120d68cd7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10270b6-10f6-483c-985b-b6daee2e63b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10270b6-10f6-483c-985b-b6daee2e63b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbc72ea-4b24-4fa3-9f34-be4495fda03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbc72ea-4b24-4fa3-9f34-be4495fda03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca37d16e-304b-4830-8e57-6f64b2df5c52', 'volume_name': 'volume-ca37d16e-304b-4830-8e57-6f64b2df5c52', 'volume_size': 2, 'snapshot_id': '85a98ffa-dc56-4eb5-89fa-12bd0ad67df8'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c4bf99-ee2c-4c2c-8ea9-1663ae1f79a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c4bf99-ee2c-4c2c-8ea9-1663ae1f79a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0cefb0-daa1-41db-bfa7-c23a62bc6c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Volume ca37d16e-304b-4830-8e57-6f64b2df5c52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca37d16e-304b-4830-8e57-6f64b2df5c52', 'volume_size': 2, 'snapshot_id': '85a98ffa-dc56-4eb5-89fa-12bd0ad67df8'} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8-ca37d16e-304b-4830-8e57-6f64b2df5c52" by "_create_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8-ca37d16e-304b-4830-8e57-6f64b2df5c52" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Creating volume ca37d16e-304b-4830-8e57-6f64b2df5c52 from snapshot 85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 {{(pid=82650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:32 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-ca37d16e-304b-4830-8e57-6f64b2df5c52" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-ca37d16e-304b-4830-8e57-6f64b2df5c52" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] snapshot: 85a98ffa-dc56-4eb5-89fa-12bd0ad67df8, volume: ca37d16e-304b-4830-8e57-6f64b2df5c52, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1714d4f1-4aa4-433f-a59e-ed5b4784d79f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:33 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 Apr 16 22:21:33 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:34 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" returned: 0 in 0.948s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4457392e-a7af-496c-84be-d75a8d7051df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[47138060-1e60-4c48-8ecc-0f4c872a8cf3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:34 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df Apr 16 22:21:34 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:34 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df" returned: 0 in 0.779s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:21:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:34 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 Apr 16 22:21:34 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Flow 'volume_create_manager' (9fff1138-0b1a-4177-96e2-f8b603a2f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a32274d-3580-4c39-b7a9-272f6113e853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a32274d-3580-4c39-b7a9-272f6113e853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2016368732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f81da64-f501-44be-b690-60370cdf9b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbaab2fbf3d74dfbb48b74d8a632d69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:36Z,use_quota=True,user_id='8458d8d1265f402db41451f6cc3fea29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4117bf1-6392-465c-b486-6dd679090927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4117bf1-6392-465c-b486-6dd679090927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ceb752e-6237-4eaa-af3a-8be74976f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ceb752e-6237-4eaa-af3a-8be74976f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f81da64-f501-44be-b690-60370cdf9b90', 'volume_name': 'volume-8f81da64-f501-44be-b690-60370cdf9b90', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d47cc0-9688-4d37-8813-6b4a5ecea80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d47cc0-9688-4d37-8813-6b4a5ecea80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11729e4e-a409-4e01-9bdb-bd5fcbc0ee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:36 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Volume 8f81da64-f501-44be-b690-60370cdf9b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f81da64-f501-44be-b690-60370cdf9b90', 'volume_size': 1} Apr 16 22:21:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:37 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52" returned: 0 in 3.018s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6dab5-055b-467c-bf2b-286b46258054]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:37 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df Apr 16 22:21:37 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:38 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df" returned: 0 in 0.719s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:38 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df, size 1024.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:21:38 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Converted 1024.00 MB image at 339.20 MB/s Apr 16 22:21:38 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 is being set with open permissions: ugo+rw Apr 16 22:21:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:38 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 Apr 16 22:21:38 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:39 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52" returned: 0 in 0.529s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-ca37d16e-304b-4830-8e57-6f64b2df5c52" released by "_copy_volume_from_snapshot" :: held 6.088s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8-ca37d16e-304b-4830-8e57-6f64b2df5c52" released by "_create_volume_from_snapshot" :: held 6.174s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.191s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.874s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Creating offline snapshot fe2c7420-c581-4381-8543-182b7052ba43 of volume 248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0cefb0-daa1-41db-bfa7-c23a62bc6c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca37d16e-304b-4830-8e57-6f64b2df5c52', 'volume_size': 2, 'snapshot_id': '85a98ffa-dc56-4eb5-89fa-12bd0ad67df8'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2f63a5-21d6-4d6c-ac0c-e183bf4b523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8aa728-2365-4e73-bf25-333115c827b3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:39 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Volume volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 (ca37d16e-304b-4830-8e57-6f64b2df5c52): created successfully Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2f63a5-21d6-4d6c-ac0c-e183bf4b523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (a2fb1876-655d-421e-8909-774baf0e6a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:39 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-905d5235-70cb-4a1e-b1a8-e28b91536872 tempest-VolumesSnapshotTestJSON-479772322 None] Created volume successfully. Apr 16 22:21:39 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 Apr 16 22:21:39 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Flow 'volume_create_manager' (7f2f360e-df16-422d-b395-e176d40193d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0290821f-1776-4692-8ba2-dbaaff4c8550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0290821f-1776-4692-8ba2-dbaaff4c8550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1312165531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5017cac1da464c3eacbdb9c29e628072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:39Z,use_quota=True,user_id='96b70c8f919545f58a2e8ee9721347d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b34fef-665c-47f1-854e-9f1f9b5f70cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b34fef-665c-47f1-854e-9f1f9b5f70cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6eac50-c5e7-47b1-b63a-a07010a7c23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6eac50-c5e7-47b1-b63a-a07010a7c23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01', 'volume_name': 'volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b05f41-6a60-4cd7-89de-d9bc6a6b2b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b05f41-6a60-4cd7-89de-d9bc6a6b2b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84333ed-bb10-4464-b98f-38f7bea1d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:39 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Volume 657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01', 'volume_size': 1} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-ca37d16e-304b-4830-8e57-6f64b2df5c52-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-ca37d16e-304b-4830-8e57-6f64b2df5c52-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-ca37d16e-304b-4830-8e57-6f64b2df5c52" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-ca37d16e-304b-4830-8e57-6f64b2df5c52" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecf27ab-d0ee-4853-a81a-6f2a66bc5a2d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:39 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 Apr 16 22:21:39 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:39 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" returned: 0 in 0.748s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:39 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 1G Apr 16 22:21:39 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:40 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52" returned: 0 in 0.894s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:40 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52 Apr 16 22:21:40 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:40 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 1G" returned: 0 in 0.754s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:40 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 Apr 16 22:21:40 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:41 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ca37d16e-304b-4830-8e57-6f64b2df5c52" returned: 0 in 0.633s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-ca37d16e-304b-4830-8e57-6f64b2df5c52" released by "delete_volume" :: held 1.573s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Created reservations ['06af2ed2-57de-41f6-a21e-6981c7bcf93b', '6e05f02d-0835-4c1e-a0f5-2367a550821a', 'afb16357-5402-4fb4-a890-c3fe346aa0b2', 'c7e8ffe6-5fb4-4044-9c50-1eaea1de53ee'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:41 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:41 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:41 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43" returned: 0 in 0.648s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:41 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 is being set with open permissions: ugo+rw Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:41 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 Apr 16 22:21:41 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-4457392e-a7af-496c-84be-d75a8d7051df" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-4457392e-a7af-496c-84be-d75a8d7051df" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Deleting offline snapshot 85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 of volume 4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] snapshot_file for this snap is: volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e089dcf9-3202-4d1a-935b-672fb0fb618e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:41 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.639s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:41 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Deleted volume successfully. Apr 16 22:21:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2f4b7fc4-cb2c-4530-9ad5-79282c50f140 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-ca37d16e-304b-4830-8e57-6f64b2df5c52-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:41 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 Apr 16 22:21:41 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:42 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43" returned: 0 in 0.712s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:42 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.info Apr 16 22:21:42 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:42 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" returned: 0 in 0.551s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4457392e-a7af-496c-84be-d75a8d7051df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:21:42 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc5207-6d13-49a8-b336-01ba5e05be2e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:42 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df Apr 16 22:21:42 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:42 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.info" returned: 0 in 0.535s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:42 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.info is being set with open permissions: ugo+rw Apr 16 22:21:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:42 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.info Apr 16 22:21:42 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:43 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df" returned: 0 in 0.581s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:43 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 Apr 16 22:21:43 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:43 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.info" returned: 0 in 0.489s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.773s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2016368732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f81da64-f501-44be-b690-60370cdf9b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbaab2fbf3d74dfbb48b74d8a632d69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:36Z,use_quota=True,user_id='8458d8d1265f402db41451f6cc3fea29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Creating volume 8f81da64-f501-44be-b690-60370cdf9b90 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:43 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:43 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 1073741824 Apr 16 22:21:43 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6f9b56bd-2602-44b5-983b-0f133d94c4f2 tempest-SnapshotDependencyTests-1659159319 None] Create snapshot completed successfully Apr 16 22:21:43 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" returned: 0 in 0.514s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:43 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8 Apr 16 22:21:43 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:43 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 1073741824" returned: 0 in 0.572s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:43 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 Apr 16 22:21:43 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:44 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df.85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" returned: 0 in 0.504s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8" released by "_delete_snapshot" :: held 2.223s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-4457392e-a7af-496c-84be-d75a8d7051df" released by "delete_snapshot" :: held 2.247s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Created reservations ['142d4f32-4381-43b4-846c-df9509a7e8d9', '30e84575-1f61-43f0-a402-f00e574198c6', 'd024f914-cc6c-4040-9cd2-3292dce0d372', 'f2637988-d52a-4da4-b8e5-9b8c06fc6a08'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Flow 'volume_create_manager' (f4a0df2b-63a6-451b-ae27-f8b8d0bf14ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19dc481-4279-49f7-813d-f779b4193f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19dc481-4279-49f7-813d-f779b4193f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5517a19-5f51-4417-8926-067f054a96a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5187d93e08e5435587c483e03681199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe2c7420-c581-4381-8543-182b7052ba43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:44Z,use_quota=True,user_id='a01c8cfec1d44dad9959c2cd519c7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3afba7-2261-43cc-908f-37b12e3f3c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3afba7-2261-43cc-908f-37b12e3f3c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fef78ab-7065-4d58-bb66-670e2b107f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fef78ab-7065-4d58-bb66-670e2b107f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5517a19-5f51-4417-8926-067f054a96a2', 'volume_name': 'volume-a5517a19-5f51-4417-8926-067f054a96a2', 'volume_size': 1, 'snapshot_id': 'fe2c7420-c581-4381-8543-182b7052ba43'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d783b9dc-de09-4a73-af09-f0ede8dfe591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d783b9dc-de09-4a73-af09-f0ede8dfe591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da43ea8-fef0-470f-a95e-2cbcfe7b82f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:44 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Volume a5517a19-5f51-4417-8926-067f054a96a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5517a19-5f51-4417-8926-067f054a96a2', 'volume_size': 1, 'snapshot_id': 'fe2c7420-c581-4381-8543-182b7052ba43'} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:44 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Delete snapshot completed successfully. Apr 16 22:21:44 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ef1585a1-0735-4b25-a95d-76a85a34a820 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-85a98ffa-dc56-4eb5-89fa-12bd0ad67df8-delete_snapshot" released by "delete_snapshot" :: held 2.465s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90" returned: 0 in 0.557s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.914s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1312165531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5017cac1da464c3eacbdb9c29e628072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:39Z,use_quota=True,user_id='96b70c8f919545f58a2e8ee9721347d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Creating volume 657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:44 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11729e4e-a409-4e01-9bdb-bd5fcbc0ee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f81da64-f501-44be-b690-60370cdf9b90', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a651a72e-14f3-4c7c-a60d-75b4f4ebdac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:44 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 1073741824 Apr 16 22:21:44 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:44 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Volume volume-8f81da64-f501-44be-b690-60370cdf9b90 (8f81da64-f501-44be-b690-60370cdf9b90): created successfully Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a651a72e-14f3-4c7c-a60d-75b4f4ebdac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Flow 'volume_create_manager' (9fff1138-0b1a-4177-96e2-f8b603a2f65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:44 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-79753a19-2b01-4efb-842c-d9a930ca87f5 tempest-VolumesMetadataTest-981982006 None] Created volume successfully. Apr 16 22:21:44 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 1073741824" returned: 0 in 0.520s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:44 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 Apr 16 22:21:44 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-4457392e-a7af-496c-84be-d75a8d7051df-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-4457392e-a7af-496c-84be-d75a8d7051df-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-4457392e-a7af-496c-84be-d75a8d7051df" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-4457392e-a7af-496c-84be-d75a8d7051df" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3fec93-ccbb-4e51-9a45-7c004bc694c2]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:45 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df Apr 16 22:21:45 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:45 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" returned: 0 in 0.503s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.069s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-quobyte-fe2c7420-c581-4381-8543-182b7052ba43-a5517a19-5f51-4417-8926-067f054a96a2" by "_create_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84333ed-bb10-4464-b98f-38f7bea1d283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cd151e-3486-4948-a992-8be4233bc42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:45 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Volume volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 (657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01): created successfully Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cd151e-3486-4948-a992-8be4233bc42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Flow 'volume_create_manager' (7f2f360e-df16-422d-b395-e176d40193d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-fe2c7420-c581-4381-8543-182b7052ba43-a5517a19-5f51-4417-8926-067f054a96a2" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Creating volume a5517a19-5f51-4417-8926-067f054a96a2 from snapshot fe2c7420-c581-4381-8543-182b7052ba43 {{(pid=82650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-quobyte-a5517a19-5f51-4417-8926-067f054a96a2" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:45 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bfc73beb-b487-4998-a6e5-4f9b3d28ef13 tempest-VolumesSnapshotListTestJSON-1275021238 None] Created volume successfully. Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-a5517a19-5f51-4417-8926-067f054a96a2" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] snapshot: fe2c7420-c581-4381-8543-182b7052ba43, volume: a5517a19-5f51-4417-8926-067f054a96a2, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c735f5e-289e-47e2-814e-421ed3f57fb2]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:45 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 Apr 16 22:21:45 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:45 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df" returned: 0 in 0.588s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:45 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df Apr 16 22:21:45 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Acquiring lock "cinder-8f81da64-f501-44be-b690-60370cdf9b90-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Lock "cinder-8f81da64-f501-44be-b690-60370cdf9b90-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Acquiring lock "cinder-quobyte-8f81da64-f501-44be-b690-60370cdf9b90" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Lock "cinder-quobyte-8f81da64-f501-44be-b690-60370cdf9b90" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c69aeeb-c729-4db3-8c54-605b9c43b828]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:46 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43" returned: 0 in 0.642s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:21:46 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 Apr 16 22:21:46 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddbae29-53d8-4523-ae67-ffdeda343822]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:46 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 Apr 16 22:21:46 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:46 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4457392e-a7af-496c-84be-d75a8d7051df" returned: 0 in 0.536s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-4457392e-a7af-496c-84be-d75a8d7051df" released by "delete_volume" :: held 1.165s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Created reservations ['3cedb367-3873-4be6-b685-ac9f8cfc95a9', '3528d23b-cd0f-440f-9432-0cbfd4bfe538', '6cd4cfee-30b4-4194-ba05-9f9e2c03f92d', '9be55f3d-444f-48b6-9bf3-a8464fad6323'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:46 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:46 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:46 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90" returned: 0 in 0.547s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:46 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90 Apr 16 22:21:46 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:46 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" returned: 0 in 0.549s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:46 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 Apr 16 22:21:46 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:46 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.441s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:46 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Deleted volume successfully. Apr 16 22:21:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6ab844ec-5da6-48dc-82a5-89bcfb35ac75 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-4457392e-a7af-496c-84be-d75a8d7051df-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:47 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f81da64-f501-44be-b690-60370cdf9b90" returned: 0 in 0.460s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Lock "cinder-quobyte-8f81da64-f501-44be-b690-60370cdf9b90" released by "delete_volume" :: held 1.036s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Created reservations ['7a299064-0e5a-4c0b-b184-50513f464005', '77da4a38-3732-4cf7-b593-c82cb6d8e331', '81c25ac1-db99-40c4-9d3b-6844643d247d', 'b7dd255a-d151-40ef-9ed9-77db1f57bd71'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:47 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:47 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:47 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (b7fbf8ce-2843-4f88-9b75-c01675266e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d870bbf0-519a-448f-ab64-a86a5ed74de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.832s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:47 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:48 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Deleted volume successfully. Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d870bbf0-519a-448f-ab64-a86a5ed74de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1847520791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6ed8e9-cdae-48a6-bb70-2ad9e693a943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3334dd33ffd94bdbae70481e2774029f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:48Z,use_quota=True,user_id='9d4073bf3b684303924d2f120d68cd7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce078e40-c988-45aa-84c2-fd46a94bb09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce078e40-c988-45aa-84c2-fd46a94bb09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45baa764-e9a0-492c-ae4b-d1a6d43abf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45baa764-e9a0-492c-ae4b-d1a6d43abf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6ed8e9-cdae-48a6-bb70-2ad9e693a943', 'volume_name': 'volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a212e367-3d9e-4a51-9431-41e2d573c977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a212e367-3d9e-4a51-9431-41e2d573c977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c704da75-0bad-4ebc-85c2-79f57204e3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:48 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Volume 5e6ed8e9-cdae-48a6-bb70-2ad9e693a943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943', 'volume_size': 1} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8e38e99d-2c14-4bc8-a5ff-af99a1581f73 tempest-VolumesMetadataTest-981982006 None] Lock "cinder-8f81da64-f501-44be-b690-60370cdf9b90-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:49 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2" returned: 0 in 2.635s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:49 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e536b-64f4-41eb-8ea8-0c387b44eab6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:49 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 Apr 16 22:21:49 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:49 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" returned: 0 in 0.687s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:49 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9, size 1024.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:21:50 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Converted 1024.00 MB image at 388.44 MB/s Apr 16 22:21:50 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 is being set with open permissions: ugo+rw Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:50 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 Apr 16 22:21:50 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:50 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2" returned: 0 in 0.448s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-a5517a19-5f51-4417-8926-067f054a96a2" released by "_copy_volume_from_snapshot" :: held 5.035s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-fe2c7420-c581-4381-8543-182b7052ba43-a5517a19-5f51-4417-8926-067f054a96a2" released by "_create_volume_from_snapshot" :: held 5.059s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.114s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.614s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Creating offline snapshot fe11fd56-9859-44e1-aefa-9730ad0abc83 of volume 657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da43ea8-fef0-470f-a95e-2cbcfe7b82f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5517a19-5f51-4417-8926-067f054a96a2', 'volume_size': 1, 'snapshot_id': 'fe2c7420-c581-4381-8543-182b7052ba43'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b377ef-3a83-431b-afd4-1478c2776611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3c84b9-5321-4293-a2a9-2ff5058b95d0]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:50 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Volume volume-a5517a19-5f51-4417-8926-067f054a96a2 (a5517a19-5f51-4417-8926-067f054a96a2): created successfully Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b377ef-3a83-431b-afd4-1478c2776611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Flow 'volume_create_manager' (f4a0df2b-63a6-451b-ae27-f8b8d0bf14ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:50 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4f78630b-8c70-4afa-bf82-223b394e5e3e tempest-SnapshotDependencyTests-1659159319 None] Created volume successfully. Apr 16 22:21:50 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 Apr 16 22:21:50 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-fe2c7420-c581-4381-8543-182b7052ba43-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-fe2c7420-c581-4381-8543-182b7052ba43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-quobyte-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-quobyte-fe2c7420-c581-4381-8543-182b7052ba43" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-fe2c7420-c581-4381-8543-182b7052ba43" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Deleting offline snapshot fe2c7420-c581-4381-8543-182b7052ba43 of volume 248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] snapshot_file for this snap is: volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920061e-6b1e-4230-9ba2-0bb38718409a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:50 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 Apr 16 22:21:50 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:51 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" returned: 0 in 0.595s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:51 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 1G Apr 16 22:21:51 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:51 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43" returned: 0 in 0.600s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:21:51 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3e63af-4a5d-40fa-b564-83a59488b3bf]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:51 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 Apr 16 22:21:51 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:51 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 1G" returned: 0 in 0.633s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:51 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 Apr 16 22:21:51 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:21:52 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Flow 'volume_create_manager' (934e33a6-473f-46cb-be81-0e16dcfdeccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3095279c-2c23-4068-9f2b-8f96fe80a8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" returned: 0 in 0.603s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:52 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 Apr 16 22:21:52 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3095279c-2c23-4068-9f2b-8f96fe80a8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-845117875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b39233-13e5-4430-aaff-5e6c1ce11710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ac2baa9678458894e287cd07126162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:52Z,use_quota=True,user_id='445ffcd104b64681adf2c3647b8391fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d730c842-0275-497c-b679-c70e76f39f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d730c842-0275-497c-b679-c70e76f39f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e701cf-d8f2-44a1-a0f8-88a4eec40f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e701cf-d8f2-44a1-a0f8-88a4eec40f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b39233-13e5-4430-aaff-5e6c1ce11710', 'volume_name': 'volume-d1b39233-13e5-4430-aaff-5e6c1ce11710', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393a7771-51cc-4ac1-b262-5beb021ba920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393a7771-51cc-4ac1-b262-5beb021ba920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2778f0-170b-4777-8091-fe79eadb8488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:52 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Volume d1b39233-13e5-4430-aaff-5e6c1ce11710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b39233-13e5-4430-aaff-5e6c1ce11710', 'volume_size': 1} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:52 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83" returned: 0 in 0.507s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:52 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 is being set with open permissions: ugo+rw Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:52 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 Apr 16 22:21:52 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:52 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43" returned: 0 in 0.555s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:52 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43 Apr 16 22:21:52 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:52 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83" returned: 0 in 0.488s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:52 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.info Apr 16 22:21:52 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:53 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9.fe2c7420-c581-4381-8543-182b7052ba43" returned: 0 in 0.515s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-fe2c7420-c581-4381-8543-182b7052ba43" released by "_delete_snapshot" :: held 2.336s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" released by "delete_snapshot" :: held 2.353s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Created reservations ['3bcfcbbb-363d-4854-aebf-cb59e89b49ca', '0d550669-1c95-47a6-af45-a720c663ae07', '81dc839e-b44f-4fb7-b80a-a7d7806c3af2', '5f490280-539d-4034-aa0c-f3e2ae02eb13'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:53 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.info" returned: 0 in 0.534s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:53 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.info is being set with open permissions: ugo+rw Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:53 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.info Apr 16 22:21:53 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:53 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Delete snapshot completed successfully. Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dc84b359-ef15-48f8-98a5-e659cf34e714 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-fe2c7420-c581-4381-8543-182b7052ba43-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:53 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.info" returned: 0 in 0.478s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.321s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.705s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1847520791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6ed8e9-cdae-48a6-bb70-2ad9e693a943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3334dd33ffd94bdbae70481e2774029f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:48Z,use_quota=True,user_id='9d4073bf3b684303924d2f120d68cd7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Creating volume 5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:53 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:53 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b6d4228a-fab5-4ea1-aa43-767846ba1302 tempest-VolumesSnapshotListTestJSON-1275021238 None] Create snapshot completed successfully Apr 16 22:21:53 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 1073741824 Apr 16 22:21:53 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-248b7c6e-16e6-433b-8d44-a6b72e8f50e9-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-248b7c6e-16e6-433b-8d44-a6b72e8f50e9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-quobyte-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[53077f9e-9639-4afb-835d-63cb0fe2757d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:54 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 Apr 16 22:21:54 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:54 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 1073741824" returned: 0 in 0.578s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:54 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 Apr 16 22:21:54 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:54 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" returned: 0 in 0.529s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:54 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9 Apr 16 22:21:54 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:54 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" returned: 0 in 0.421s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.668s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-845117875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b39233-13e5-4430-aaff-5e6c1ce11710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ac2baa9678458894e287cd07126162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:21:52Z,use_quota=True,user_id='445ffcd104b64681adf2c3647b8391fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Creating volume d1b39233-13e5-4430-aaff-5e6c1ce11710 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:21:54 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c704da75-0bad-4ebc-85c2-79f57204e3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:54 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 1073741824 Apr 16 22:21:54 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b5c005-b0f4-44c4-a3d9-b4baf193f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:54 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Volume volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 (5e6ed8e9-cdae-48a6-bb70-2ad9e693a943): created successfully Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b5c005-b0f4-44c4-a3d9-b4baf193f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (b7fbf8ce-2843-4f88-9b75-c01675266e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:54 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3660746c-6e13-402e-9f40-f7c1afd6a125 tempest-VolumesSnapshotTestJSON-479772322 None] Created volume successfully. Apr 16 22:21:55 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" returned: 0 in 0.428s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-248b7c6e-16e6-433b-8d44-a6b72e8f50e9" released by "delete_volume" :: held 0.998s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Created reservations ['38646c82-bd8d-4143-b3d8-972c5ef78db9', 'e0f9c6c8-3463-44b8-8cbc-ebe39617eef2', '782053f5-0cb3-4b97-9410-22be588cf6e2', '731f7a19-4cdc-4878-ba51-69e76c425871'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:55 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:55 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:55 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 1073741824" returned: 0 in 0.567s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:55 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 Apr 16 22:21:55 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:55 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.569s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Deleted volume successfully. Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f0ebe7b1-5a2c-4a80-ad98-c461bd7f8995 tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-248b7c6e-16e6-433b-8d44-a6b72e8f50e9-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:55 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710" returned: 0 in 0.469s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.553s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Creating offline snapshot 10171183-570e-426a-9678-7955f0935332 of volume 657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2778f0-170b-4777-8091-fe79eadb8488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b39233-13e5-4430-aaff-5e6c1ce11710', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f14e40-3cf7-47df-b561-3eb9609c2be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d248d-2fc3-474b-adf6-c7b7632622e2]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:55 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Volume volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 (d1b39233-13e5-4430-aaff-5e6c1ce11710): created successfully Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f14e40-3cf7-47df-b561-3eb9609c2be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:21:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Flow 'volume_create_manager' (934e33a6-473f-46cb-be81-0e16dcfdeccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:21:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c01f124a-f8ed-4896-a9e9-5f48972d0d6a tempest-VolumesTransfersV355Test-974006347 None] Created volume successfully. Apr 16 22:21:56 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 Apr 16 22:21:56 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-a5517a19-5f51-4417-8926-067f054a96a2-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-a5517a19-5f51-4417-8926-067f054a96a2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "cinder-quobyte-a5517a19-5f51-4417-8926-067f054a96a2" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-a5517a19-5f51-4417-8926-067f054a96a2" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e4e7b6-4068-4e0d-beb5-d3f4a0e1ff11]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:56 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 Apr 16 22:21:56 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:56 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83" returned: 0 in 0.613s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:21:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:56 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 1G Apr 16 22:21:56 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:56 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-805a286a-c62a-4f9c-ad56-ca13b6871d36 tempest-VolumesTransfersV355Test-699785354 None] Transfer volume completed successfully. Apr 16 22:21:57 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2" returned: 0 in 0.721s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:57 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2 Apr 16 22:21:57 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:57 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 1G" returned: 0 in 0.633s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:57 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 Apr 16 22:21:57 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:57 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a5517a19-5f51-4417-8926-067f054a96a2" returned: 0 in 0.520s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-quobyte-a5517a19-5f51-4417-8926-067f054a96a2" released by "delete_volume" :: held 1.286s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Created reservations ['6531ce43-6f4e-4fda-8b0b-21df48823ce2', '43a80299-31a0-48f4-91ca-208451829fae', '72343018-b9c6-4fd0-9bf9-5b91c1a62c56', '1fe4dbb2-8364-4fa5-974e-0c68338a19b4'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:57 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332" returned: 0 in 0.515s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:57 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 is being set with open permissions: ugo+rw Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:57 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:57 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Acquiring lock "cinder-d1b39233-13e5-4430-aaff-5e6c1ce11710-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:57 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 Apr 16 22:21:57 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Lock "cinder-d1b39233-13e5-4430-aaff-5e6c1ce11710-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Acquiring lock "cinder-quobyte-d1b39233-13e5-4430-aaff-5e6c1ce11710" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Lock "cinder-quobyte-d1b39233-13e5-4430-aaff-5e6c1ce11710" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ab603-0931-43a6-a18e-d1bd31dfdfb5]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:57 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 Apr 16 22:21:57 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:58 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.440s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:58 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Deleted volume successfully. Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-539ee719-b84d-475b-966d-5e4077d84a9a tempest-SnapshotDependencyTests-1659159319 None] Lock "cinder-a5517a19-5f51-4417-8926-067f054a96a2-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:58 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332" returned: 0 in 0.455s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.644s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Creating offline snapshot 8befd982-0452-4423-9751-f4b9ee18fc0f of volume 5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f670f-8f2c-4c72-9e0d-22cd5e52aede]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:58 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-fc44cb7d-c63b-4f20-ba7c-cae35f2e0898 tempest-VolumesSnapshotListTestJSON-1275021238 None] Create snapshot completed successfully Apr 16 22:21:58 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710" returned: 0 in 0.521s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:58 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 Apr 16 22:21:58 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:58 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710 Apr 16 22:21:58 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:58 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" returned: 0 in 0.651s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:58 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f 1G Apr 16 22:21:58 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:58 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d1b39233-13e5-4430-aaff-5e6c1ce11710" returned: 0 in 0.604s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Lock "cinder-quobyte-d1b39233-13e5-4430-aaff-5e6c1ce11710" released by "delete_volume" :: held 1.154s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:21:58 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Created reservations ['e8526492-72f5-477a-81af-7f97854cc259', '9ab90822-b0a3-423e-8731-2c7f3d0663fe', '783f3043-2869-4857-b440-27da50783f2f', 'c172bdd0-34ee-4112-beec-7f9e40b42f7a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:59 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:21:59 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:59 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f 1G" returned: 0 in 0.734s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:21:59 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.581s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:21:59 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Deleted volume successfully. Apr 16 22:21:59 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f Apr 16 22:21:59 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:21:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-41ba132d-4c20-4eec-90c3-5c45fab03629 tempest-VolumesTransfersV355Test-1513210620 None] Lock "cinder-d1b39233-13e5-4430-aaff-5e6c1ce11710-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:00 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f" returned: 0 in 0.648s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:00 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f is being set with open permissions: ugo+rw Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:00 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f Apr 16 22:22:00 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Flow 'volume_create_manager' (f8ac9c7a-4c15-4216-88eb-930de4e2feeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db6fe31-fce5-47f5-b5e6-49201d027369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db6fe31-fce5-47f5-b5e6-49201d027369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1060406932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69249867-08d5-4cae-9978-df8f8fbbf32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ac2baa9678458894e287cd07126162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:00Z,use_quota=True,user_id='445ffcd104b64681adf2c3647b8391fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59932bcc-d666-4351-be61-f3b360dc9cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59932bcc-d666-4351-be61-f3b360dc9cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43b3faf-cc94-4841-9434-b1c5ff66b12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43b3faf-cc94-4841-9434-b1c5ff66b12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69249867-08d5-4cae-9978-df8f8fbbf32d', 'volume_name': 'volume-69249867-08d5-4cae-9978-df8f8fbbf32d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a862d0df-bdf6-466c-a02f-10436606e0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a862d0df-bdf6-466c-a02f-10436606e0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a299e34-99a8-4e1c-acd3-64deca56fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:00 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Volume 69249867-08d5-4cae-9978-df8f8fbbf32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69249867-08d5-4cae-9978-df8f8fbbf32d', 'volume_size': 1} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:00 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f" returned: 0 in 0.596s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:00 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.info Apr 16 22:22:00 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:01 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.info" returned: 0 in 0.650s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:01 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.info is being set with open permissions: ugo+rw Apr 16 22:22:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:01 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.info Apr 16 22:22:01 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:02 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.info" returned: 0 in 0.668s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.049s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.371s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Creating offline snapshot 65b2abae-ba36-4297-b667-fb7a61863848 of volume 657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c694ae-d0bd-4656-9132-da2acd58d4c5]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-89eadb27-395e-4f98-b47e-af53c4f0dda3 tempest-VolumesSnapshotTestJSON-479772322 None] Create snapshot completed successfully Apr 16 22:22:02 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 Apr 16 22:22:02 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:02 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332" returned: 0 in 0.621s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:02 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 1G Apr 16 22:22:02 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (16e16f47-090c-4d00-847b-45f470cddad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576747e1-976e-4875-827f-51332f46c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576747e1-976e-4875-827f-51332f46c230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-316065018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed6f5ba-f654-47d9-ab71-139f10af3660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3334dd33ffd94bdbae70481e2774029f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8befd982-0452-4423-9751-f4b9ee18fc0f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:03Z,use_quota=True,user_id='9d4073bf3b684303924d2f120d68cd7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8102a97d-a5c2-4a3d-b03f-31eabd4fa65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8102a97d-a5c2-4a3d-b03f-31eabd4fa65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31bfa8d9-0c4f-48d1-89b8-5da0da649702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31bfa8d9-0c4f-48d1-89b8-5da0da649702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ed6f5ba-f654-47d9-ab71-139f10af3660', 'volume_name': 'volume-6ed6f5ba-f654-47d9-ab71-139f10af3660', 'volume_size': 1, 'snapshot_id': '8befd982-0452-4423-9751-f4b9ee18fc0f'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e425bd6-4f61-4d15-8705-11a16329df29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e425bd6-4f61-4d15-8705-11a16329df29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4222064a-bfc6-4f0d-9f72-ad0ebba51dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:03 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Volume 6ed6f5ba-f654-47d9-ab71-139f10af3660: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ed6f5ba-f654-47d9-ab71-139f10af3660', 'volume_size': 1, 'snapshot_id': '8befd982-0452-4423-9751-f4b9ee18fc0f'} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:03 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 1G" returned: 0 in 0.759s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:03 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 Apr 16 22:22:03 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:04 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848" returned: 0 in 0.578s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:04 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 is being set with open permissions: ugo+rw Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:04 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 Apr 16 22:22:04 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:04 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848" returned: 0 in 0.597s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.465s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1060406932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69249867-08d5-4cae-9978-df8f8fbbf32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ac2baa9678458894e287cd07126162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:00Z,use_quota=True,user_id='445ffcd104b64681adf2c3647b8391fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Creating volume 69249867-08d5-4cae-9978-df8f8fbbf32d {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:04 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:04 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ab8409a9-0488-4748-8904-fa7a9275a78c tempest-VolumesSnapshotListTestJSON-1275021238 None] Create snapshot completed successfully Apr 16 22:22:04 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d 1073741824 Apr 16 22:22:04 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:05 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d 1073741824" returned: 0 in 0.792s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:05 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d Apr 16 22:22:05 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-65b2abae-ba36-4297-b667-fb7a61863848-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-65b2abae-ba36-4297-b667-fb7a61863848-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-quobyte-65b2abae-ba36-4297-b667-fb7a61863848" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-65b2abae-ba36-4297-b667-fb7a61863848" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Deleting offline snapshot 65b2abae-ba36-4297-b667-fb7a61863848 of volume 657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] snapshot_file for this snap is: volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[38105c7b-3865-4bde-8eb2-36b8a201d6af]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:06 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 Apr 16 22:22:06 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:06 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d" returned: 0 in 0.671s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.091s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-8befd982-0452-4423-9751-f4b9ee18fc0f-6ed6f5ba-f654-47d9-ab71-139f10af3660" by "_create_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a299e34-99a8-4e1c-acd3-64deca56fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69249867-08d5-4cae-9978-df8f8fbbf32d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d6212c-1b8b-451b-9eac-964d057706ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:06 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Volume volume-69249867-08d5-4cae-9978-df8f8fbbf32d (69249867-08d5-4cae-9978-df8f8fbbf32d): created successfully Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d6212c-1b8b-451b-9eac-964d057706ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Flow 'volume_create_manager' (f8ac9c7a-4c15-4216-88eb-930de4e2feeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-8befd982-0452-4423-9751-f4b9ee18fc0f-6ed6f5ba-f654-47d9-ab71-139f10af3660" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Creating volume 6ed6f5ba-f654-47d9-ab71-139f10af3660 from snapshot 8befd982-0452-4423-9751-f4b9ee18fc0f {{(pid=82650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-6ed6f5ba-f654-47d9-ab71-139f10af3660" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-6ed6f5ba-f654-47d9-ab71-139f10af3660" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] snapshot: 8befd982-0452-4423-9751-f4b9ee18fc0f, volume: 6ed6f5ba-f654-47d9-ab71-139f10af3660, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:06 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4016a60e-6d09-42bb-91b1-e5f80bc777d6 tempest-VolumesTransfersV355Test-974006347 None] Created volume successfully. Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec82f777-4de0-425b-ae95-ddf8d5aba0ee]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:06 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f Apr 16 22:22:06 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:07 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848" returned: 0 in 0.804s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b9aa5b-409f-40af-9991-594d01550228]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Acquiring lock "cinder-69249867-08d5-4cae-9978-df8f8fbbf32d-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:07 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 Apr 16 22:22:07 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Lock "cinder-69249867-08d5-4cae-9978-df8f8fbbf32d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Acquiring lock "cinder-quobyte-69249867-08d5-4cae-9978-df8f8fbbf32d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Lock "cinder-quobyte-69249867-08d5-4cae-9978-df8f8fbbf32d" acquired by "delete_volume" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca0f73-869a-4e00-aba8-4eabec5ad25d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:07 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f" returned: 0 in 0.878s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:22:07 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d Apr 16 22:22:07 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f7527-dc52-48a2-aa0f-25da7fa4ab6c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:07 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 Apr 16 22:22:07 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:07 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332" returned: 0 in 0.845s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:07 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 Apr 16 22:22:07 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:08 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" returned: 0 in 0.622s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:08 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 Apr 16 22:22:08 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:08 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d" returned: 0 in 0.795s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:08 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d Apr 16 22:22:08 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:08 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848" returned: 0 in 0.757s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:08 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848 Apr 16 22:22:08 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:08 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-69249867-08d5-4cae-9978-df8f8fbbf32d" returned: 0 in 0.624s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Lock "cinder-quobyte-69249867-08d5-4cae-9978-df8f8fbbf32d" released by "delete_volume" :: held 1.502s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:09 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Created reservations ['cfc6428c-cf5b-459f-8452-50a5541f676f', '03adf7ba-a6fb-4a92-9338-db1f82fb021b', '940e1e26-154c-4d32-9510-9231879d219f', '35e3d8f9-bc5d-4230-ac19-514b08b13037'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:09 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:09 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:10 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.65b2abae-ba36-4297-b667-fb7a61863848" returned: 0 in 2.265s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-65b2abae-ba36-4297-b667-fb7a61863848" released by "_delete_snapshot" :: held 4.774s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" released by "delete_snapshot" :: held 4.795s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:11 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.946s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Deleted volume successfully. Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-71396202-78e6-41e4-98a5-d04233968127 tempest-VolumesTransfersV355Test-1513210620 None] Lock "cinder-69249867-08d5-4cae-9978-df8f8fbbf32d-delete_volume" released by "delete_volume" :: held 4.050s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Created reservations ['b29ec7bc-f6d7-4c0a-b455-7b232fd1c03f', '08d9387a-38c3-4e26-b246-218c8a1dbbc9', '02628832-425e-4330-81cb-8776407ee83d', '9418f559-56ef-4063-b3ad-25b8378de105'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:11 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660" returned: 0 in 3.227s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Delete snapshot completed successfully. Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d6832105-bad3-43eb-a0fa-078d3b50faee tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-65b2abae-ba36-4297-b667-fb7a61863848-delete_snapshot" released by "delete_snapshot" :: held 5.141s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[40707d86-b9e9-41f4-ba33-f42847da68b4]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:11 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 Apr 16 22:22:11 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-10171183-570e-426a-9678-7955f0935332-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-10171183-570e-426a-9678-7955f0935332-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-quobyte-10171183-570e-426a-9678-7955f0935332" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-10171183-570e-426a-9678-7955f0935332" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Deleting offline snapshot 10171183-570e-426a-9678-7955f0935332 of volume 657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] snapshot_file for this snap is: volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8029891-8555-4367-add4-af1cf6dd3b36]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:11 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 Apr 16 22:22:11 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:12 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" returned: 0 in 0.839s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943, size 1024.00 MB, duration 3.23 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:22:12 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Converted 1024.00 MB image at 317.16 MB/s Apr 16 22:22:12 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 is being set with open permissions: ugo+rw Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:12 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 Apr 16 22:22:12 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:12 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332" returned: 0 in 0.634s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7493a319-7b07-47c5-b5d8-3b48420a5b02]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:12 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 Apr 16 22:22:12 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:12 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660" returned: 0 in 0.526s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-6ed6f5ba-f654-47d9-ab71-139f10af3660" released by "_copy_volume_from_snapshot" :: held 6.232s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-8befd982-0452-4423-9751-f4b9ee18fc0f-6ed6f5ba-f654-47d9-ab71-139f10af3660" released by "_create_volume_from_snapshot" :: held 6.260s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.307s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4222064a-bfc6-4f0d-9f72-ad0ebba51dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed6f5ba-f654-47d9-ab71-139f10af3660', 'volume_size': 1, 'snapshot_id': '8befd982-0452-4423-9751-f4b9ee18fc0f'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c19750-6590-40db-a222-cc47006e2ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:12 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Volume volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 (6ed6f5ba-f654-47d9-ab71-139f10af3660): created successfully Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c19750-6590-40db-a222-cc47006e2ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Flow 'volume_create_manager' (16e16f47-090c-4d00-847b-45f470cddad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:12 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-02b7cf8c-03a0-4209-85a9-21b1c3d5c9ea tempest-VolumesSnapshotTestJSON-479772322 None] Created volume successfully. Apr 16 22:22:12 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83" returned: 0 in 0.626s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:12 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 Apr 16 22:22:12 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-6ed6f5ba-f654-47d9-ab71-139f10af3660-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-6ed6f5ba-f654-47d9-ab71-139f10af3660-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-6ed6f5ba-f654-47d9-ab71-139f10af3660" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-6ed6f5ba-f654-47d9-ab71-139f10af3660" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:13 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcb18b2-9c4a-4d27-8bfc-aaf41a398f3f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:13 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 Apr 16 22:22:13 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:13 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332" returned: 0 in 0.667s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:13 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332 Apr 16 22:22:13 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:14 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660" returned: 0 in 0.589s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:14 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660 Apr 16 22:22:14 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:14 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.10171183-570e-426a-9678-7955f0935332" returned: 0 in 0.533s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-10171183-570e-426a-9678-7955f0935332" released by "_delete_snapshot" :: held 2.544s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" released by "delete_snapshot" :: held 2.563s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Created reservations ['5795a5ae-de4c-4b1f-b8c4-5b06486cb730', '295eaa18-4ba0-4edc-b24f-a4b592bd4409', 'b15df345-a91a-4ec5-a58c-16df8810090a', '26896097-6e82-4a35-80f4-0ac0892ee99f'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:14 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Delete snapshot completed successfully. Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3facab7b-a46e-4161-bbcc-fa666aa9085a tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-10171183-570e-426a-9678-7955f0935332-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:14 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6ed6f5ba-f654-47d9-ab71-139f10af3660" returned: 0 in 0.523s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-6ed6f5ba-f654-47d9-ab71-139f10af3660" released by "delete_volume" :: held 1.143s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Created reservations ['e4ea6512-636d-4987-a3eb-824c90e446b6', '141b77dc-944c-43d9-85af-6584e2eace15', 'f388d801-92fb-4f4e-904e-721ac8442ab0', '5300cf2e-1cc1-4252-ab3d-7af9a65b91ed'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:14 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:14 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-8befd982-0452-4423-9751-f4b9ee18fc0f-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-8befd982-0452-4423-9751-f4b9ee18fc0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-8befd982-0452-4423-9751-f4b9ee18fc0f" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-8befd982-0452-4423-9751-f4b9ee18fc0f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Deleting offline snapshot 8befd982-0452-4423-9751-f4b9ee18fc0f of volume 5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] snapshot_file for this snap is: volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f30c135-97b5-4dbd-8cda-76753b4ddc47]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-fe11fd56-9859-44e1-aefa-9730ad0abc83-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-fe11fd56-9859-44e1-aefa-9730ad0abc83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-quobyte-fe11fd56-9859-44e1-aefa-9730ad0abc83" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-fe11fd56-9859-44e1-aefa-9730ad0abc83" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Deleting offline snapshot fe11fd56-9859-44e1-aefa-9730ad0abc83 of volume 657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:22:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] snapshot_file for this snap is: volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2590ba0-9184-42cf-8fa0-742c667d215a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:15 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f Apr 16 22:22:15 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Flow 'volume_create_manager' (7a404d2e-582a-4061-b5a6-34e05d551071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:15 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 Apr 16 22:22:15 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35250f4-a628-43b7-9be1-52830c5acb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35250f4-a628-43b7-9be1-52830c5acb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-837067760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44ad902-7bf8-4f08-8c3e-d0f779d423a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a0a5ab6cf449939a8b8d620c8aa40a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:15Z,use_quota=True,user_id='3ed1702795b2463eb9f56ee766193046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e2144c-bbf6-4d53-bbea-e5f3fe9df836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e2144c-bbf6-4d53-bbea-e5f3fe9df836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ce24c3-741d-4f35-93af-a1a2832991ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ce24c3-741d-4f35-93af-a1a2832991ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44ad902-7bf8-4f08-8c3e-d0f779d423a9', 'volume_name': 'volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728a2a94-7343-4516-8ee3-73ab1042ec74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728a2a94-7343-4516-8ee3-73ab1042ec74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ae82f2-c67f-482a-b9f1-f1280a815f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:15 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Volume a44ad902-7bf8-4f08-8c3e-d0f779d423a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9', 'volume_size': 1} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-837067760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44ad902-7bf8-4f08-8c3e-d0f779d423a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a0a5ab6cf449939a8b8d620c8aa40a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:15Z,use_quota=True,user_id='3ed1702795b2463eb9f56ee766193046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Creating volume a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:15 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:15 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 1073741824 Apr 16 22:22:15 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:15 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.721s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:15 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Deleted volume successfully. Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9b36e9b6-5dfb-4568-8d5d-54c6b3872dbc tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-6ed6f5ba-f654-47d9-ab71-139f10af3660-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:15 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f" returned: 0 in 0.679s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c688c4-d3ef-40dd-bcc1-f1ab05354683]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:15 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 Apr 16 22:22:15 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:15 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83" returned: 0 in 0.789s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2757d7e6-6b57-4c8d-a53c-e15d4303e48b]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:15 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 Apr 16 22:22:15 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:16 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 1073741824" returned: 0 in 0.841s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:16 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 Apr 16 22:22:16 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:16 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" returned: 0 in 0.815s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:16 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f Apr 16 22:22:16 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:16 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" returned: 0 in 0.758s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:16 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 Apr 16 22:22:16 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:16 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" returned: 0 in 0.756s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ae82f2-c67f-482a-b9f1-f1280a815f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcb972d-1750-47a2-859b-a1493bfe7688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:16 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Volume volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 (a44ad902-7bf8-4f08-8c3e-d0f779d423a9): created successfully Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcb972d-1750-47a2-859b-a1493bfe7688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Flow 'volume_create_manager' (7a404d2e-582a-4061-b5a6-34e05d551071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:16 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4ef756f4-45c4-4043-bff7-78d5139a3222 tempest-VolumesCloneTest-316646164 None] Created volume successfully. Apr 16 22:22:17 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f" returned: 0 in 0.648s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:17 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f Apr 16 22:22:17 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:17 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83" returned: 0 in 0.678s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:17 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83 Apr 16 22:22:17 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Flow 'volume_create_manager' (024a0a29-d0de-4ea4-b834-f948ffda2e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db89f90a-e52d-4c04-aed5-083a261a880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db89f90a-e52d-4c04-aed5-083a261a880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1832791062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1763b9b-4b41-44c7-bf02-686edeba477d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a0a5ab6cf449939a8b8d620c8aa40a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a44ad902-7bf8-4f08-8c3e-d0f779d423a9,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:18Z,use_quota=True,user_id='3ed1702795b2463eb9f56ee766193046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16281d5-d828-446d-b092-57bd412372f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16281d5-d828-446d-b092-57bd412372f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:17 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82eec848-e36f-4704-b042-0e2d48717de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943.8befd982-0452-4423-9751-f4b9ee18fc0f" returned: 0 in 0.641s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82eec848-e36f-4704-b042-0e2d48717de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b1763b9b-4b41-44c7-bf02-686edeba477d', 'volume_name': 'volume-b1763b9b-4b41-44c7-bf02-686edeba477d', 'volume_size': 2, 'source_volid': 'a44ad902-7bf8-4f08-8c3e-d0f779d423a9', 'source_volstatus': 'available'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985d54dc-6146-4f85-b62d-2c44a69b55da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985d54dc-6146-4f85-b62d-2c44a69b55da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b6631d-7f67-4bfc-b78f-cebe92ac273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:17 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Volume b1763b9b-4b41-44c7-bf02-686edeba477d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b1763b9b-4b41-44c7-bf02-686edeba477d', 'volume_size': 2, 'source_volid': 'a44ad902-7bf8-4f08-8c3e-d0f779d423a9', 'source_volstatus': 'available'} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-8befd982-0452-4423-9751-f4b9ee18fc0f" released by "_delete_snapshot" :: held 2.919s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:17 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Cloning volume a44ad902-7bf8-4f08-8c3e-d0f779d423a9 to volume b1763b9b-4b41-44c7-bf02-686edeba477d Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" released by "delete_snapshot" :: held 2.960s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Creating offline snapshot de6905c1-add4-4c85-9327-f28017217015 of volume a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a30512-8f0f-4de2-9c64-09cc3a93c6e4]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Created reservations ['991c9a43-6153-4f55-8dec-9c8a06f4b511', 'e38c3bb3-a449-4e73-9da8-9890ceb54269', 'b1a8a3a3-846f-40b1-96aa-608f9a1bed40', '5a95ff2b-069a-45b2-9222-d5977ccc553b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:17 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 Apr 16 22:22:17 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:17 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01.fe11fd56-9859-44e1-aefa-9730ad0abc83" returned: 0 in 0.691s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:17 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Delete snapshot completed successfully. Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ee3fcf06-6b26-4ae6-b97f-7712af602746 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-8befd982-0452-4423-9751-f4b9ee18fc0f-delete_snapshot" released by "delete_snapshot" :: held 3.171s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-fe11fd56-9859-44e1-aefa-9730ad0abc83" released by "_delete_snapshot" :: held 2.999s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" released by "delete_snapshot" :: held 3.025s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Created reservations ['d47d5ac4-73f2-498f-85d8-f40ed03d75ec', '660e6def-4aea-4549-be13-d7a5bcb2ec64', 'ca27ab20-7927-4b43-b264-36debe8d66e1', '679fd780-f8b2-4179-9b1d-59311a113866'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:18 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Delete snapshot completed successfully. Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6941d11f-d12a-46d9-b466-adbff0893af8 tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-fe11fd56-9859-44e1-aefa-9730ad0abc83-delete_snapshot" released by "delete_snapshot" :: held 3.215s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6342a3b9-1629-4e81-95b8-8be20313311f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:18 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 Apr 16 22:22:18 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:18 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" returned: 0 in 0.754s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:18 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 1G Apr 16 22:22:18 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:18 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" returned: 0 in 0.640s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:18 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943 Apr 16 22:22:18 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:19 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 1G" returned: 0 in 0.573s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:19 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 Apr 16 22:22:19 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabb7866-dc8c-4d21-8458-3c41c9bfc313]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:19 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 Apr 16 22:22:19 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:19 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" returned: 0 in 0.531s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943" released by "delete_volume" :: held 1.215s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Created reservations ['586696af-20e6-4cd8-89e2-29356f6d6cc9', '86315cdd-83c8-47b6-ab9b-fff41066c9ae', '22c933e8-88e6-4e21-9986-70a8178e2482', '39fd1fe3-313e-4e69-823d-306baf136934'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:19 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:19 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:19 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015" returned: 0 in 0.646s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:19 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 is being set with open permissions: ugo+rw Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:19 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 Apr 16 22:22:19 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:19 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" returned: 0 in 0.604s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:19 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01 Apr 16 22:22:19 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:20 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.482s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:20 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Deleted volume successfully. Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9664d8e9-c41f-4478-b048-cabd9c3613d5 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-5e6ed8e9-cdae-48a6-bb70-2ad9e693a943-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:20 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015" returned: 0 in 0.511s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:20 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.info Apr 16 22:22:20 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:20 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" returned: 0 in 0.500s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-quobyte-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01" released by "delete_volume" :: held 1.167s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Created reservations ['ff92bec8-d669-448b-aa34-2840d4b05745', '9364127e-0a1f-4934-bdf2-e8417dc350ca', '96833fb1-5642-4a8e-aa76-8e4b11b387a3', '019a2bae-6140-4625-b3ab-adc5735b5e4c'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-99bad2c4-babe-43d0-a3cb-a1947a992d6c-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-99bad2c4-babe-43d0-a3cb-a1947a992d6c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:20 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:20 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "cinder-quobyte-99bad2c4-babe-43d0-a3cb-a1947a992d6c" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-99bad2c4-babe-43d0-a3cb-a1947a992d6c" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6273c3-3a64-419a-ad2c-f433b5122fd8]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:20 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c Apr 16 22:22:20 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:20 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.info" returned: 0 in 0.532s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:20 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.info is being set with open permissions: ugo+rw Apr 16 22:22:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:20 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.info Apr 16 22:22:20 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:21 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.564s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:21 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Deleted volume successfully. Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-cc14a50f-546c-48a9-ac26-b18e25a8ce3c tempest-VolumesSnapshotListTestJSON-1275021238 None] Lock "cinder-657e5bb5-1e0c-4ee8-94ae-4af3ea4a1e01-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:21 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c" returned: 0 in 0.604s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:21 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c Apr 16 22:22:21 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:21 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.info" returned: 0 in 0.529s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Acquiring lock "cinder-quobyte-b1763b9b-4b41-44c7-bf02-686edeba477d" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Lock "cinder-quobyte-b1763b9b-4b41-44c7-bf02-686edeba477d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] snapshot: de6905c1-add4-4c85-9327-f28017217015, volume: b1763b9b-4b41-44c7-bf02-686edeba477d, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d43872-2d65-4562-b83a-edbb71a36eb5]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:21 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 Apr 16 22:22:21 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:21 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-99bad2c4-babe-43d0-a3cb-a1947a992d6c" returned: 0 in 0.631s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-quobyte-99bad2c4-babe-43d0-a3cb-a1947a992d6c" released by "delete_volume" :: held 1.277s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:21 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Created reservations ['fcb9ad4f-3751-4c17-b1ad-09794bf81327', '3eb0ed3c-e4ce-4e69-b55f-97168f7c1b17', '7f4e74f5-65a0-4968-8236-32a4f66565b8', 'cd4d1801-9955-4677-b8ef-1f8459c6a553'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:22 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:22 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:22 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015" returned: 0 in 0.629s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d705b89-8974-45b9-861c-3e8d8003173d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:22 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 Apr 16 22:22:22 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:22 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.654s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:22 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Deleted volume successfully. Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f9d5345-b017-4a35-ac18-199a16dcb6f0 tempest-VolumesSnapshotTestJSON-479772322 None] Lock "cinder-99bad2c4-babe-43d0-a3cb-a1947a992d6c-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:22 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" returned: 0 in 0.660s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:22:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:22 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d Apr 16 22:22:22 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:22:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:24 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:24 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:DELETE=13,cinder:SELECT=160,cinder:UPDATE=184,cinder:INSERT=48 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (88879c43-4daf-46b3-bd4b-eff89321a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d066f06a-3e84-4098-b34d-bd34c69b11d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d066f06a-3e84-4098-b34d-bd34c69b11d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-741738729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:25Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c11a15b-de3c-4ecc-869d-150948708cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c11a15b-de3c-4ecc-869d-150948708cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d70080-d0f4-4ed7-ab5a-810af161af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d70080-d0f4-4ed7-ab5a-810af161af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a', 'volume_name': 'volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f26de8-ea24-45c4-ad91-25eca76b01da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f26de8-ea24-45c4-ad91-25eca76b01da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71361c48-c591-444d-8801-1e7b6cfe0c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:25 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a', 'volume_size': 1} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:25 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d" returned: 0 in 2.860s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e67f49f-ed33-42da-b33e-ca914ca9b785]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:25 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 Apr 16 22:22:25 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:25 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.384s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:22:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:22:26 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" returned: 0 in 0.767s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9, size 1024.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:22:26 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Converted 1024.00 MB image at 357.93 MB/s Apr 16 22:22:26 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d is being set with open permissions: ugo+rw Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:26 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d Apr 16 22:22:26 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:26 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d" returned: 0 in 0.499s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Lock "cinder-quobyte-b1763b9b-4b41-44c7-bf02-686edeba477d" released by "_copy_volume_from_snapshot" :: held 5.473s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Acquiring lock "cinder-quobyte-de6905c1-add4-4c85-9327-f28017217015" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Lock "cinder-quobyte-de6905c1-add4-4c85-9327-f28017217015" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Deleting offline snapshot de6905c1-add4-4c85-9327-f28017217015 of volume a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] snapshot_file for this snap is: volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6571c4b-5047-4ab2-ae5a-e93a81816158]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:27 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 Apr 16 22:22:27 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:27 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015" returned: 0 in 0.638s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:27 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:27 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[89531475-37ac-4e3e-bc02-4e131759c6c9]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:27 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 Apr 16 22:22:27 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:28 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" returned: 0 in 0.608s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:28 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 Apr 16 22:22:28 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:28 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015" returned: 0 in 0.702s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:28 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015 Apr 16 22:22:28 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:29 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9.de6905c1-add4-4c85-9327-f28017217015" returned: 0 in 0.643s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Lock "cinder-quobyte-de6905c1-add4-4c85-9327-f28017217015" released by "_delete_snapshot" :: held 2.653s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.848s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.141s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-741738729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:25Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Creating volume fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:29 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b6631d-7f67-4bfc-b78f-cebe92ac273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1763b9b-4b41-44c7-bf02-686edeba477d', 'volume_size': 2, 'source_volid': 'a44ad902-7bf8-4f08-8c3e-d0f779d423a9', 'source_volstatus': 'available'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373fac72-03bd-4594-8f30-46e65aa63e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:29 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Volume volume-b1763b9b-4b41-44c7-bf02-686edeba477d (b1763b9b-4b41-44c7-bf02-686edeba477d): created successfully Apr 16 22:22:29 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a 1073741824 Apr 16 22:22:29 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373fac72-03bd-4594-8f30-46e65aa63e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:29 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Flow 'volume_create_manager' (024a0a29-d0de-4ea4-b834-f948ffda2e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:29 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-794cd0fa-3c0c-43c9-aba8-b11716f43cf5 tempest-VolumesCloneTest-316646164 None] Created volume successfully. Apr 16 22:22:30 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a 1073741824" returned: 0 in 0.592s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:UPDATE=176,cinder:SELECT=133,cinder:DELETE=16,cinder:INSERT=47 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:30 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a Apr 16 22:22:30 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Flow 'volume_create_manager' (20753d6d-5420-4b16-b855-8d4a420168d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62d76b6-411e-4e54-9687-82c420d15a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62d76b6-411e-4e54-9687-82c420d15a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2086570042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c6309c-356d-4b22-b3bd-73393ffe5cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84bfbe5e694343a4c818e09cd87c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:31Z,use_quota=True,user_id='618dee71d8b54a86b7282f418326feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670beef4-128f-4b43-a1c9-fc77c256882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670beef4-128f-4b43-a1c9-fc77c256882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad5b4f6-eaf4-45d6-bcc1-11b86d99237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad5b4f6-eaf4-45d6-bcc1-11b86d99237d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c6309c-356d-4b22-b3bd-73393ffe5cae', 'volume_name': 'volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae', 'volume_size': 2}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4838db04-9612-4c06-b24b-a080c404427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4838db04-9612-4c06-b24b-a080c404427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b56243b-6001-40d2-8875-63e01c4e8890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:30 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Volume c1c6309c-356d-4b22-b3bd-73393ffe5cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae', 'volume_size': 2} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:30 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" returned: 0 in 0.633s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.218s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2086570042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c6309c-356d-4b22-b3bd-73393ffe5cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84bfbe5e694343a4c818e09cd87c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:31Z,use_quota=True,user_id='618dee71d8b54a86b7282f418326feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Creating volume c1c6309c-356d-4b22-b3bd-73393ffe5cae {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:30 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae 2147483648 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Acquiring lock "cinder-b1763b9b-4b41-44c7-bf02-686edeba477d-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:30 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae 2147483648 Apr 16 22:22:30 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71361c48-c591-444d-8801-1e7b6cfe0c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28f012b-bd0e-405b-a68b-71586236fcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Lock "cinder-b1763b9b-4b41-44c7-bf02-686edeba477d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:31 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a (fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a): created successfully Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28f012b-bd0e-405b-a68b-71586236fcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (88879c43-4daf-46b3-bd4b-eff89321a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:31 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-507e0227-2b86-4302-a6a1-06b9374bb17a tempest-CreateVolumesFromSnapshotTest-503231282 None] Created volume successfully. Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Acquiring lock "cinder-quobyte-b1763b9b-4b41-44c7-bf02-686edeba477d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Lock "cinder-quobyte-b1763b9b-4b41-44c7-bf02-686edeba477d" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c5900f-3866-4425-8cf1-198bde6ff915]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:31 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d Apr 16 22:22:31 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:31 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae 2147483648" returned: 0 in 0.761s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:31 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae Apr 16 22:22:31 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:31 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d" returned: 0 in 0.743s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:31 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d Apr 16 22:22:31 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:32 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae" returned: 0 in 0.678s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.444s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Creating offline snapshot be55d10b-43dc-4a9a-b1f7-65b83acebe5a of volume fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b56243b-6001-40d2-8875-63e01c4e8890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae', 'volume_size': 2}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8d73d3-fca0-485b-98fe-8b5513a47665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe6b70c-d07b-4306-a5f6-3cf9926baaed]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:32 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Volume volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae (c1c6309c-356d-4b22-b3bd-73393ffe5cae): created successfully Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8d73d3-fca0-485b-98fe-8b5513a47665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Flow 'volume_create_manager' (20753d6d-5420-4b16-b855-8d4a420168d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b1763b9b-4b41-44c7-bf02-686edeba477d" returned: 0 in 0.707s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Lock "cinder-quobyte-b1763b9b-4b41-44c7-bf02-686edeba477d" released by "delete_volume" :: held 1.482s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:32 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-249d0174-acaa-48b1-8007-c87cde64f79c tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Created volume successfully. Apr 16 22:22:32 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a Apr 16 22:22:32 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Created reservations ['4aa9479e-6724-4c6d-ab21-52e3880c8808', 'fc83e548-79c1-45ad-9ff5-f908574f1fad', '712a934b-f299-4e46-921a-cbf0eb0a9559', 'a242c232-9a4d-4c8d-87f4-fce3bb64ddd1'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:32 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:32 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:33 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" returned: 0 in 0.710s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:33 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a 1G Apr 16 22:22:33 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Acquiring lock "cinder-a44ad902-7bf8-4f08-8c3e-d0f779d423a9-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Lock "cinder-a44ad902-7bf8-4f08-8c3e-d0f779d423a9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Acquiring lock "cinder-quobyte-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Lock "cinder-quobyte-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:33 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.627s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:33 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Deleted volume successfully. Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2374882e-61c5-448e-9b19-4a1500df8ebc]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b8ae51bc-0bef-4a12-8c3c-a3268c5ef5ab tempest-VolumesCloneTest-316646164 None] Lock "cinder-b1763b9b-4b41-44c7-bf02-686edeba477d-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:33 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 Apr 16 22:22:33 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:33 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a 1G" returned: 0 in 0.648s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:33 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a Apr 16 22:22:33 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:33 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" returned: 0 in 0.591s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:33 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9 Apr 16 22:22:33 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:34 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a" returned: 0 in 0.560s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:34 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a is being set with open permissions: ugo+rw Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:34 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" returned: 0 in 0.515s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:34 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a Apr 16 22:22:34 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Lock "cinder-quobyte-a44ad902-7bf8-4f08-8c3e-d0f779d423a9" released by "delete_volume" :: held 1.165s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Created reservations ['1971d106-3200-42a1-aed5-0d1c9281b8a4', 'e7f81a39-c040-4523-9aa1-f150812d75c8', '01de4b03-8798-47b6-97c1-dc85cc39ae63', '5fa21a67-2675-499b-8f37-8f8a071c8f9c'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:34 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:34 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:34 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a" returned: 0 in 0.556s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:35 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.info Apr 16 22:22:35 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:35 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.577s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:35 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:35 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Deleted volume successfully. Apr 16 22:22:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-89d1a597-da63-48b6-8ed7-886828ff5fee tempest-VolumesCloneTest-316646164 None] Lock "cinder-a44ad902-7bf8-4f08-8c3e-d0f779d423a9-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:35 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.info" returned: 0 in 0.537s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:35 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.info is being set with open permissions: ugo+rw Apr 16 22:22:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:35 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.info Apr 16 22:22:35 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:36 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.info" returned: 0 in 0.599s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.721s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.248s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Creating offline snapshot dafcd697-423f-4c16-b918-473d9ef7661d of volume c1c6309c-356d-4b22-b3bd-73393ffe5cae {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:22:36 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-0821b9af-c73b-4b22-8d57-61da6f4f02af tempest-CreateVolumesFromSnapshotTest-503231282 None] Create snapshot completed successfully Apr 16 22:22:36 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[217bdab0-6eef-46a9-9e85-6c0cf75ba60e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:36 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae Apr 16 22:22:36 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:37 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae" returned: 0 in 0.791s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d 2G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:37 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d 2G Apr 16 22:22:37 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (585c3330-8973-4c3a-8a92-faa45e0adc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b04fd3-160e-4965-b7e9-8308d456baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b04fd3-160e-4965-b7e9-8308d456baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722266869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2555849-2178-4474-a441-0470ecea824a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:38Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8e3efb-401d-428f-86f6-37c221fb9e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8e3efb-401d-428f-86f6-37c221fb9e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfccf03-e9f9-4f0b-bd8b-3e19b8b7e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfccf03-e9f9-4f0b-bd8b-3e19b8b7e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2555849-2178-4474-a441-0470ecea824a', 'volume_name': 'volume-a2555849-2178-4474-a441-0470ecea824a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31eccc9-057b-412a-bf07-488fdcdd8a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31eccc9-057b-412a-bf07-488fdcdd8a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c4efa0-df2b-4834-91c6-c309b5596d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:37 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume a2555849-2178-4474-a441-0470ecea824a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2555849-2178-4474-a441-0470ecea824a', 'volume_size': 1} Apr 16 22:22:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:37 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d 2G" returned: 0 in 0.986s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:38 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d Apr 16 22:22:38 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (48418aa9-7e7a-4a18-b350-4039e78e2dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ede32ed-fb4b-4a44-abd1-ddd9c2830a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ede32ed-fb4b-4a44-abd1-ddd9c2830a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-243273144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499d36b1-c561-4e73-a28f-f715b022c26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:38Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8408383c-bd1a-442c-b4b8-1bf3fecf0880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8408383c-bd1a-442c-b4b8-1bf3fecf0880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10970740-47b9-4179-ba98-77782ca8b290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10970740-47b9-4179-ba98-77782ca8b290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499d36b1-c561-4e73-a28f-f715b022c26a', 'volume_name': 'volume-499d36b1-c561-4e73-a28f-f715b022c26a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20ec35b-6205-4d4a-b03c-42eac9b96188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20ec35b-6205-4d4a-b03c-42eac9b96188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae922992-cf63-4b69-b454-aeaa8a2720c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume 499d36b1-c561-4e73-a28f-f715b022c26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499d36b1-c561-4e73-a28f-f715b022c26a', 'volume_size': 1} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (9878ddd2-d17d-4c5d-ab31-2440d4e2dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca9daed-6b1d-4cc0-946e-d0a8fffc19fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca9daed-6b1d-4cc0-946e-d0a8fffc19fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1508668757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2610072b-f7b5-4c78-a6aa-77d9e9332118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:38Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f456a40-262e-44db-91e8-f8d20a611c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f456a40-262e-44db-91e8-f8d20a611c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc22516-aa7f-4388-bb60-e4a09cc57d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc22516-aa7f-4388-bb60-e4a09cc57d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2610072b-f7b5-4c78-a6aa-77d9e9332118', 'volume_name': 'volume-2610072b-f7b5-4c78-a6aa-77d9e9332118', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d6de84-f0c0-4149-ac31-d4725a48ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d6de84-f0c0-4149-ac31-d4725a48ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72030023-8105-4929-abb3-7f5e9d39ccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume 2610072b-f7b5-4c78-a6aa-77d9e9332118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2610072b-f7b5-4c78-a6aa-77d9e9332118', 'volume_size': 1} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Flow 'volume_create_manager' (02778604-9e3e-4b37-b9c6-d135608a3bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6076a2a8-1b6a-4710-b917-fc5b888c029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6076a2a8-1b6a-4710-b917-fc5b888c029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-27346653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df25509-0768-45be-9442-bcd99cd7a50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe85bbaf72458b95c287786f3d0843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:39Z,use_quota=True,user_id='10f93ad47a294815bbc4c22dc5a8ce1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8204e8-c388-422c-a174-6c7a98435473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8204e8-c388-422c-a174-6c7a98435473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4cf33b-0e3d-4b2e-baba-8151ef3af515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4cf33b-0e3d-4b2e-baba-8151ef3af515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df25509-0768-45be-9442-bcd99cd7a50f', 'volume_name': 'volume-6df25509-0768-45be-9442-bcd99cd7a50f', 'volume_size': 2}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26be8473-8488-4305-be39-cc8a17efaff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26be8473-8488-4305-be39-cc8a17efaff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f6d5fa-1bce-47e1-8a61-b1c95da843ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Volume 6df25509-0768-45be-9442-bcd99cd7a50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df25509-0768-45be-9442-bcd99cd7a50f', 'volume_size': 2} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (cfab67b0-1dc6-4211-86ed-f84a356fdb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cdd148-cac4-4be1-a491-d458c52f0176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cdd148-cac4-4be1-a491-d458c52f0176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298808878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0d751d-5ef7-4b31-b297-7cb284e6a8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:39Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b3d510-360f-4ffb-9830-b85ec10e41cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b3d510-360f-4ffb-9830-b85ec10e41cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6538760-648d-4f33-9933-dae1d1e646f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6538760-648d-4f33-9933-dae1d1e646f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0d751d-5ef7-4b31-b297-7cb284e6a8a8', 'volume_name': 'volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b2887f-0b4a-4a7c-a7ba-b88b59fe776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b2887f-0b4a-4a7c-a7ba-b88b59fe776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e45a33-e25f-4fa6-a227-6396c024d7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:38 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume 3c0d751d-5ef7-4b31-b297-7cb284e6a8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8', 'volume_size': 1} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d" returned: 0 in 0.873s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:38 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d is being set with open permissions: ugo+rw Apr 16 22:22:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:38 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d Apr 16 22:22:38 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (b3879e7f-f9c8-44a1-a4aa-92559d9e91a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67f5a2f-564d-4fc0-b340-eb6a468518ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67f5a2f-564d-4fc0-b340-eb6a468518ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1008213492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8ae5d1-fb8c-4371-a00a-028048363230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:39Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6adea1e-eed1-46c3-b849-79beb5247ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6adea1e-eed1-46c3-b849-79beb5247ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a557bb-674d-4110-9f23-6ba0f8adbd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a557bb-674d-4110-9f23-6ba0f8adbd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8ae5d1-fb8c-4371-a00a-028048363230', 'volume_name': 'volume-aa8ae5d1-fb8c-4371-a00a-028048363230', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4719836-bfec-4c82-951f-635972a14796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4719836-bfec-4c82-951f-635972a14796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784a3ced-dbc9-46af-b0d9-5646b05ad09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:39 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume aa8ae5d1-fb8c-4371-a00a-028048363230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8ae5d1-fb8c-4371-a00a-028048363230', 'volume_size': 1} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:39 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d" returned: 0 in 0.489s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:39 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.info Apr 16 22:22:39 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:39 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.info" returned: 0 in 0.485s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:39 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.info is being set with open permissions: ugo+rw Apr 16 22:22:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:39 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.info Apr 16 22:22:39 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:40 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.info" returned: 0 in 0.535s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.251s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.635s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722266869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2555849-2178-4474-a441-0470ecea824a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:38Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Creating volume a2555849-2178-4474-a441-0470ecea824a {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:40 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:40 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4603641a-44ae-4239-b86d-430eea0c57c1 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Create snapshot completed successfully Apr 16 22:22:40 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a 1073741824 Apr 16 22:22:40 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:41 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a 1073741824" returned: 0 in 0.667s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:41 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a Apr 16 22:22:41 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "cinder-dafcd697-423f-4c16-b918-473d9ef7661d-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-dafcd697-423f-4c16-b918-473d9ef7661d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "cinder-quobyte-c1c6309c-356d-4b22-b3bd-73393ffe5cae" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-quobyte-c1c6309c-356d-4b22-b3bd-73393ffe5cae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "cinder-quobyte-dafcd697-423f-4c16-b918-473d9ef7661d" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-quobyte-dafcd697-423f-4c16-b918-473d9ef7661d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Deleting offline snapshot dafcd697-423f-4c16-b918-473d9ef7661d of volume c1c6309c-356d-4b22-b3bd-73393ffe5cae {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] snapshot_file for this snap is: volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70911c-1a76-4780-9f26-68a6620967c3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:41 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a" returned: 0 in 0.662s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.524s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-243273144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499d36b1-c561-4e73-a28f-f715b022c26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:38Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Creating volume 499d36b1-c561-4e73-a28f-f715b022c26a {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:41 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c4efa0-df2b-4834-91c6-c309b5596d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2555849-2178-4474-a441-0470ecea824a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0e0cc6-07a7-4e19-b999-6531b65fb1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:41 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a 1073741824 Apr 16 22:22:41 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:41 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume volume-a2555849-2178-4474-a441-0470ecea824a (a2555849-2178-4474-a441-0470ecea824a): created successfully Apr 16 22:22:41 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d Apr 16 22:22:41 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0e0cc6-07a7-4e19-b999-6531b65fb1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (585c3330-8973-4c3a-8a92-faa45e0adc48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:41 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3a716c6d-03fa-4570-80c2-ea5d5de57895 tempest-CreateVolumesFromSnapshotTest-503231282 None] Created volume successfully. Apr 16 22:22:42 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d" returned: 0 in 0.663s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:22:42 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5d81d3-7366-4e23-81f9-107225caaa8f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:42 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae Apr 16 22:22:42 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:42 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a 1073741824" returned: 0 in 0.847s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:42 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a Apr 16 22:22:42 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:43 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae" returned: 0 in 0.667s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:43 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d Apr 16 22:22:43 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:43 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a" returned: 0 in 0.619s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.742s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1508668757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2610072b-f7b5-4c78-a6aa-77d9e9332118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:38Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Creating volume 2610072b-f7b5-4c78-a6aa-77d9e9332118 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:43 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae922992-cf63-4b69-b454-aeaa8a2720c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499d36b1-c561-4e73-a28f-f715b022c26a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b56c33-bcd1-446e-a33c-3d85d123e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:43 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 1073741824 Apr 16 22:22:43 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:43 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume volume-499d36b1-c561-4e73-a28f-f715b022c26a (499d36b1-c561-4e73-a28f-f715b022c26a): created successfully Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b56c33-bcd1-446e-a33c-3d85d123e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (48418aa9-7e7a-4a18-b350-4039e78e2dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6b0b2bf5-629c-4c09-a002-68bf91ddd0c9 tempest-CreateVolumesFromSnapshotTest-503231282 None] Created volume successfully. Apr 16 22:22:43 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d" returned: 0 in 0.664s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:43 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d Apr 16 22:22:43 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:44 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 1073741824" returned: 0 in 0.680s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:44 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 Apr 16 22:22:44 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:44 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae.dafcd697-423f-4c16-b918-473d9ef7661d" returned: 0 in 0.627s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-quobyte-dafcd697-423f-4c16-b918-473d9ef7661d" released by "_delete_snapshot" :: held 2.720s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-quobyte-c1c6309c-356d-4b22-b3bd-73393ffe5cae" released by "delete_snapshot" :: held 2.745s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Created reservations ['a739d08d-697f-46a4-9a57-f4c18522356b', '9465df2a-7f2d-4967-ba19-f5d7288f9403', '489dba5e-cf1c-4a79-9e44-c713ca2312d7', 'c86dec26-25d8-4627-8c11-8d4d0ace78e3'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:44 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Delete snapshot completed successfully. Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f560ea2d-9424-4d3a-a076-4cd8222c5ca9 tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-dafcd697-423f-4c16-b918-473d9ef7661d-delete_snapshot" released by "delete_snapshot" :: held 2.900s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:44 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118" returned: 0 in 0.588s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.946s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-27346653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df25509-0768-45be-9442-bcd99cd7a50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fe85bbaf72458b95c287786f3d0843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:39Z,use_quota=True,user_id='10f93ad47a294815bbc4c22dc5a8ce1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Creating volume 6df25509-0768-45be-9442-bcd99cd7a50f {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:44 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f 2147483648 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72030023-8105-4929-abb3-7f5e9d39ccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2610072b-f7b5-4c78-a6aa-77d9e9332118', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0b0924-c918-4549-978b-95353a35a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:44 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f 2147483648 Apr 16 22:22:44 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:44 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 (2610072b-f7b5-4c78-a6aa-77d9e9332118): created successfully Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0b0924-c918-4549-978b-95353a35a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (9878ddd2-d17d-4c5d-ab31-2440d4e2dce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:44 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bd5474c8-ef2f-4203-a6e7-cb02ca264e06 tempest-CreateVolumesFromSnapshotTest-503231282 None] Created volume successfully. Apr 16 22:22:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "cinder-c1c6309c-356d-4b22-b3bd-73393ffe5cae-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-c1c6309c-356d-4b22-b3bd-73393ffe5cae-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "cinder-quobyte-c1c6309c-356d-4b22-b3bd-73393ffe5cae" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-quobyte-c1c6309c-356d-4b22-b3bd-73393ffe5cae" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0495576-a561-49cf-a11d-eb7f86b6f4b6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:45 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae Apr 16 22:22:45 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:45 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f 2147483648" returned: 0 in 0.731s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:45 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f Apr 16 22:22:45 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:45 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae" returned: 0 in 0.687s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:45 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae Apr 16 22:22:45 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:46 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f" returned: 0 in 0.597s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.188s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298808878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0d751d-5ef7-4b31-b297-7cb284e6a8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:39Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Creating volume 3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:46 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:46 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 1073741824 Apr 16 22:22:46 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f6d5fa-1bce-47e1-8a61-b1c95da843ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df25509-0768-45be-9442-bcd99cd7a50f', 'volume_size': 2}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c61ef7-f6bd-4afd-b3d0-d4e0fd36fc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:46 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Volume volume-6df25509-0768-45be-9442-bcd99cd7a50f (6df25509-0768-45be-9442-bcd99cd7a50f): created successfully Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c61ef7-f6bd-4afd-b3d0-d4e0fd36fc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Flow 'volume_create_manager' (02778604-9e3e-4b37-b9c6-d135608a3bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:46 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-dc9c8b89-8ab6-4c60-b6e8-7cbf38b8d931 tempest-VolumesCloneNegativeTest-1553076160 None] Created volume successfully. Apr 16 22:22:46 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c1c6309c-356d-4b22-b3bd-73393ffe5cae" returned: 0 in 0.559s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-quobyte-c1c6309c-356d-4b22-b3bd-73393ffe5cae" released by "delete_volume" :: held 1.292s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Created reservations ['b78b3507-443b-417d-b0f5-08ba1d4e723b', 'b91004ab-90db-4f9a-b408-f2785a1b7b91', '3c1b3098-9a64-4498-87b0-dcb50742af81', 'fd089a7d-92d5-4043-8a0a-9ec5fd6eeeed'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:46 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:46 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:46 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 1073741824" returned: 0 in 0.638s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:46 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 Apr 16 22:22:46 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:47 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.634s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:47 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Deleted volume successfully. Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a974ec65-435d-468c-b559-04f60cb5e7cd tempest-VolumesSnapshotNegativeTestJSON-1521399324 None] Lock "cinder-c1c6309c-356d-4b22-b3bd-73393ffe5cae-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Acquiring lock "cinder-6df25509-0768-45be-9442-bcd99cd7a50f-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "cinder-6df25509-0768-45be-9442-bcd99cd7a50f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Acquiring lock "cinder-quobyte-6df25509-0768-45be-9442-bcd99cd7a50f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "cinder-quobyte-6df25509-0768-45be-9442-bcd99cd7a50f" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc86d43-2bed-490b-9889-89f66821f374]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:47 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8" returned: 0 in 0.692s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.314s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1008213492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8ae5d1-fb8c-4371-a00a-028048363230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44787cd611c43919bedb2d2630dc5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:39Z,use_quota=True,user_id='b2465a39875c451496796b0947a35064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Creating volume aa8ae5d1-fb8c-4371-a00a-028048363230 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:47 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e45a33-e25f-4fa6-a227-6396c024d7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:47 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 1073741824 Apr 16 22:22:47 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3326daa4-38c1-4975-9cad-7189eb720a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:47 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 (3c0d751d-5ef7-4b31-b297-7cb284e6a8a8): created successfully Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3326daa4-38c1-4975-9cad-7189eb720a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:47 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (cfab67b0-1dc6-4211-86ed-f84a356fdb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:47 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-debbf0a5-bbbc-4bf3-a0c6-2798c74eaf6d tempest-CreateVolumesFromSnapshotTest-503231282 None] Created volume successfully. Apr 16 22:22:47 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f Apr 16 22:22:47 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:48 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f" returned: 0 in 0.695s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:48 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f Apr 16 22:22:48 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:48 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 1073741824" returned: 0 in 0.758s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:48 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 Apr 16 22:22:48 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:48 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6df25509-0768-45be-9442-bcd99cd7a50f" returned: 0 in 0.649s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "cinder-quobyte-6df25509-0768-45be-9442-bcd99cd7a50f" released by "delete_volume" :: held 1.384s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Created reservations ['f2da23e3-1816-4f62-923e-1b96ad808585', 'bc8b0260-7470-4fe8-b1ff-abc3ac695d5f', '001498b4-2a8d-4fe6-a732-c5416267de2c', '3908e9d1-a77a-4bcd-93c9-09898d02a600'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:48 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:48 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:49 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230" returned: 0 in 0.801s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784a3ced-dbc9-46af-b0d9-5646b05ad09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8ae5d1-fb8c-4371-a00a-028048363230', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b036b3-3a15-4bae-8199-ea17cd1b3e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:49 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Volume volume-aa8ae5d1-fb8c-4371-a00a-028048363230 (aa8ae5d1-fb8c-4371-a00a-028048363230): created successfully Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b036b3-3a15-4bae-8199-ea17cd1b3e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Flow 'volume_create_manager' (b3879e7f-f9c8-44a1-a4aa-92559d9e91a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-648bb4ea-8211-4024-b6f3-6ba8987eb53e tempest-CreateVolumesFromSnapshotTest-503231282 None] Created volume successfully. Apr 16 22:22:49 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.553s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Deleted volume successfully. Apr 16 22:22:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1d09680d-b28d-47b4-8208-d555e3692ed8 tempest-VolumesCloneNegativeTest-1553076160 None] Lock "cinder-6df25509-0768-45be-9442-bcd99cd7a50f-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (be96cc00-91d4-4f22-8ac0-ef4f85c9ca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bf3864-3440-4991-a0ae-317ec946aed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-aa8ae5d1-fb8c-4371-a00a-028048363230-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bf3864-3440-4991-a0ae-317ec946aed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233596889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00592e01-73ef-4837-aded-742ac3c0ccc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:50Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8298c1ad-5bef-46a5-ad22-980251d40c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8298c1ad-5bef-46a5-ad22-980251d40c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75620ce9-b817-4c10-a58c-42b1e2031b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75620ce9-b817-4c10-a58c-42b1e2031b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00592e01-73ef-4837-aded-742ac3c0ccc9', 'volume_name': 'volume-00592e01-73ef-4837-aded-742ac3c0ccc9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e438f4-0c67-46f4-b43c-91b411bac60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e438f4-0c67-46f4-b43c-91b411bac60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4541b1-8c15-4d54-9a78-2ca33113b2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Volume 00592e01-73ef-4837-aded-742ac3c0ccc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00592e01-73ef-4837-aded-742ac3c0ccc9', 'volume_size': 1} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233596889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00592e01-73ef-4837-aded-742ac3c0ccc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:50Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Creating volume 00592e01-73ef-4837-aded-742ac3c0ccc9 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:50 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:50 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 1073741824 Apr 16 22:22:50 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-aa8ae5d1-fb8c-4371-a00a-028048363230-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-quobyte-aa8ae5d1-fb8c-4371-a00a-028048363230" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-aa8ae5d1-fb8c-4371-a00a-028048363230" acquired by "delete_volume" :: waited 0.033s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f382a25d-d016-47da-b87d-4c9901173691]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:50 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 Apr 16 22:22:50 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (585e68c2-3931-4961-8399-a627bc0ea7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f3ddbe-536d-4220-a5ae-9a3589f076d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f3ddbe-536d-4220-a5ae-9a3589f076d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611909253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3238909c-709b-4f26-ae2b-bd3d374e9f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:50Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea2c5ea-d293-422b-908f-64ccc656b2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea2c5ea-d293-422b-908f-64ccc656b2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3228a4-7f48-4970-be01-44f07b1a0b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3228a4-7f48-4970-be01-44f07b1a0b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3238909c-709b-4f26-ae2b-bd3d374e9f3e', 'volume_name': 'volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e67666c-72aa-48c4-a6df-b9cbfb0d4b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e67666c-72aa-48c4-a6df-b9cbfb0d4b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5509ae-2042-430e-8779-50e5ca0cdd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Volume 3238909c-709b-4f26-ae2b-bd3d374e9f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e', 'volume_size': 1} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (139f94b0-c673-4838-8834-e055c45c4c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44198e3a-993e-4ecb-bc49-7c0db7e3cb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44198e3a-993e-4ecb-bc49-7c0db7e3cb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2132061733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:51Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06000e5a-25a3-4c61-9423-1839c0c6de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06000e5a-25a3-4c61-9423-1839c0c6de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5a34f7-d764-43b1-ad30-ba00f7fe7164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5a34f7-d764-43b1-ad30-ba00f7fe7164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750', 'volume_name': 'volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae7e855-acfb-40dd-85bf-690474a87aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae7e855-acfb-40dd-85bf-690474a87aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf021935-4f1c-48a4-ba8d-fc3e5d10d10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:50 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Volume ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750', 'volume_size': 1} Apr 16 22:22:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (0b5811bc-6972-42f5-afeb-72ca1674c036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4328ec50-5a12-45ca-856c-ac2eeb218dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4328ec50-5a12-45ca-856c-ac2eeb218dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-377902633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa228b4-400b-4c46-bd0f-455f4d9459f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:51Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985000ea-18d9-429b-8ace-4d34999bd815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985000ea-18d9-429b-8ace-4d34999bd815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98f854f-c776-4672-868e-2e84e896efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98f854f-c776-4672-868e-2e84e896efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa228b4-400b-4c46-bd0f-455f4d9459f7', 'volume_name': 'volume-caa228b4-400b-4c46-bd0f-455f4d9459f7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70691c9-e8dc-47d7-bd18-8b06dcabb7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70691c9-e8dc-47d7-bd18-8b06dcabb7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83bc916-4eb9-4ec2-9830-423ebbd6e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Volume caa228b4-400b-4c46-bd0f-455f4d9459f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa228b4-400b-4c46-bd0f-455f4d9459f7', 'volume_size': 1} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 1073741824" returned: 0 in 1.067s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230" returned: 0 in 0.946s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:51 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230 Apr 16 22:22:51 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:51 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 Apr 16 22:22:51 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (040ede7d-20ca-40bf-8fd8-37376971d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eef5488-7435-436d-82e9-b97cd17ce9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eef5488-7435-436d-82e9-b97cd17ce9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440587798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd08285d-c814-4106-8990-f4bb0b6943f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:51Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c6e4d6-fe61-4b1c-a26b-229e3fb518c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c6e4d6-fe61-4b1c-a26b-229e3fb518c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ff8bc1-7e56-496c-9abe-1bb671f33176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ff8bc1-7e56-496c-9abe-1bb671f33176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd08285d-c814-4106-8990-f4bb0b6943f4', 'volume_name': 'volume-bd08285d-c814-4106-8990-f4bb0b6943f4', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480f5bac-bb02-46ac-a4fd-9f6bd653b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480f5bac-bb02-46ac-a4fd-9f6bd653b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c5638b-397e-4f53-a8f0-539ffff6e259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Volume bd08285d-c814-4106-8990-f4bb0b6943f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd08285d-c814-4106-8990-f4bb0b6943f4', 'volume_size': 1} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:51 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9" returned: 0 in 0.601s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.349s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611909253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3238909c-709b-4f26-ae2b-bd3d374e9f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:50Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Creating volume 3238909c-709b-4f26-ae2b-bd3d374e9f3e {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:51 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:51 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-aa8ae5d1-fb8c-4371-a00a-028048363230" returned: 0 in 0.689s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:51 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e 1073741824 Apr 16 22:22:51 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4541b1-8c15-4d54-9a78-2ca33113b2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00592e01-73ef-4837-aded-742ac3c0ccc9', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14024904-4484-457f-993a-23dc360a5a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-aa8ae5d1-fb8c-4371-a00a-028048363230" released by "delete_volume" :: held 1.706s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:51 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Volume volume-00592e01-73ef-4837-aded-742ac3c0ccc9 (00592e01-73ef-4837-aded-742ac3c0ccc9): created successfully Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14024904-4484-457f-993a-23dc360a5a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:51 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (be96cc00-91d4-4f22-8ac0-ef4f85c9ca60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:52 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-373853a4-89e5-4308-8e23-b1a8afc76d1b tempest-CreateVolumesFromImageTest-136722499 None] Created volume successfully. Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Created reservations ['dbf6daa0-5369-48bf-81fa-11f2f190244c', 'e144143d-4926-4ad0-9005-ff6d99dcf68a', 'b4d92f3f-73e0-476f-9c61-73b9c1b584c6', 'e721c792-1192-459a-9128-f781bb1fbf40'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:52 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:52 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-quobyte-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba99ab9f-6dcb-4818-8faf-e597833fa4db]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:52 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 Apr 16 22:22:52 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:52 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e 1073741824" returned: 0 in 0.658s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:52 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e Apr 16 22:22:52 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Flow 'volume_create_manager' (a6f2dfaf-e0bd-4eb3-b53d-a784c42b3e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350d2350-e72d-4e9d-a92b-9376a94edcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:52 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350d2350-e72d-4e9d-a92b-9376a94edcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-36768955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b235eca0-1309-4b30-afc9-1771d81fddcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c839fdd6ed4d61bf11b5e3f6e9a7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:53Z,use_quota=True,user_id='c2f5867813e8495591c853d028380614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c8c88e-e59b-469a-9adf-44ae2b0a76db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c8c88e-e59b-469a-9adf-44ae2b0a76db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5b578b-b03b-4ece-893f-5f48ad1e7ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.image.glance [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Creating Keystone auth plugin from conf {{(pid=82650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.654s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:52 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Deleted volume successfully. Apr 16 22:22:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-471d5ac7-119b-4940-a5c0-74c5cfeb9ea6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-aa8ae5d1-fb8c-4371-a00a-028048363230-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5b578b-b03b-4ece-893f-5f48ad1e7ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b235eca0-1309-4b30-afc9-1771d81fddcc', 'volume_name': 'volume-b235eca0-1309-4b30-afc9-1771d81fddcc', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31ef036-4b12-4ba0-b348-4c3289f714d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31ef036-4b12-4ba0-b348-4c3289f714d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c91648-42d7-43e6-b533-873391d677c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:53 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Volume b235eca0-1309-4b30-afc9-1771d81fddcc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b235eca0-1309-4b30-afc9-1771d81fddcc', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Trying to clone b235eca0-1309-4b30-afc9-1771d81fddcc from image fc1a3fa2-bedc-4143-856a-42ade81658d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]). {{(pid=82650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 22:22:53 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8" returned: 0 in 0.701s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:53 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8 Apr 16 22:22:53 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:53 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e" returned: 0 in 0.612s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.324s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2132061733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:51Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Creating volume ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:53 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:53 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 1073741824 Apr 16 22:22:53 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5509ae-2042-430e-8779-50e5ca0cdd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1946abd-66ba-45e4-9591-e1de8e31b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 22:22:53 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Image download 20.69 MB at 20.69 MB/s Apr 16 22:22:53 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Volume volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e (3238909c-709b-4f26-ae2b-bd3d374e9f3e): created successfully Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1946abd-66ba-45e4-9591-e1de8e31b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (585e68c2-3931-4961-8399-a627bc0ea7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9774bd1-5e33-4eeb-b885-72d88ca48506]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:53 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e3766be3-e7c7-4aea-9e07-daa000d9d3be tempest-CreateVolumesFromImageTest-136722499 None] Created volume successfully. Apr 16 22:22:53 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD Apr 16 22:22:53 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:53 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8" returned: 0 in 0.522s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8" released by "delete_volume" :: held 1.254s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Created reservations ['7fda5fd6-c47c-4da9-9d10-d6a021e787cb', 'e036d1f9-7a1f-476b-9411-a25342b8d308', '52746064-3e37-45f3-9f62-1752634d604f', 'bfabd142-4bea-40aa-a0b4-2c2d616bc4f6'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:53 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:53 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:53 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 1073741824" returned: 0 in 0.736s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:54 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Temporary image fc1a3fa2-bedc-4143-856a-42ade81658d5 is fetched for user c2f5867813e8495591c853d028380614. {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 22:22:54 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 Apr 16 22:22:54 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbc56ca-c9da-4b52-91ea-17b6a6950ead]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:54 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD Apr 16 22:22:54 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:54 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.630s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:54 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Deleted volume successfully. Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f9e26154-15bc-4863-9b26-6af54ede1901 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-3c0d751d-5ef7-4b31-b297-7cb284e6a8a8-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:54 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750" returned: 0 in 0.532s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.326s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-377902633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa228b4-400b-4c46-bd0f-455f4d9459f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:51Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Creating volume caa228b4-400b-4c46-bd0f-455f4d9459f7 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:54 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-2610072b-f7b5-4c78-a6aa-77d9e9332118-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:54 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 1073741824 Apr 16 22:22:54 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf021935-4f1c-48a4-ba8d-fc3e5d10d10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5773fc-d442-40d4-8102-226b2c1ddded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-2610072b-f7b5-4c78-a6aa-77d9e9332118-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:54 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Volume volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 (ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750): created successfully Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5773fc-d442-40d4-8102-226b2c1ddded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (139f94b0-c673-4838-8834-e055c45c4c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:54 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-22b92aea-7f78-4afa-90c0-0132fe681535 tempest-CreateVolumesFromImageTest-136722499 None] Created volume successfully. Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-quobyte-2610072b-f7b5-4c78-a6aa-77d9e9332118" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-2610072b-f7b5-4c78-a6aa-77d9e9332118" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd9292b-79cc-442d-b921-91ccfa6e6a2d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:54 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:54 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 Apr 16 22:22:54 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:55 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 1073741824" returned: 0 in 0.644s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:55 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 Apr 16 22:22:55 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:55 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118" returned: 0 in 0.665s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:55 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118 Apr 16 22:22:55 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:55 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7" returned: 0 in 0.517s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.166s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440587798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd08285d-c814-4106-8990-f4bb0b6943f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa36e170954a4fa216c8eacc584f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:51Z,use_quota=True,user_id='3c8ecf4e6d5e485e8daa3a4a7ca9396f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Creating volume bd08285d-c814-4106-8990-f4bb0b6943f4 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:55 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83bc916-4eb9-4ec2-9830-423ebbd6e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa228b4-400b-4c46-bd0f-455f4d9459f7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a257547b-5ac8-49c1-9326-1d970ef3a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:55 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 1073741824 Apr 16 22:22:55 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:55 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Volume volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 (caa228b4-400b-4c46-bd0f-455f4d9459f7): created successfully Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a257547b-5ac8-49c1-9326-1d970ef3a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (0b5811bc-6972-42f5-afeb-72ca1674c036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-90fdcb94-b781-4798-b3f0-769d6e6911d4 tempest-CreateVolumesFromImageTest-136722499 None] Created volume successfully. Apr 16 22:22:55 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-2610072b-f7b5-4c78-a6aa-77d9e9332118" returned: 0 in 0.527s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-2610072b-f7b5-4c78-a6aa-77d9e9332118" released by "delete_volume" :: held 1.223s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:55 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Created reservations ['350bdfc0-0f0f-4add-8d48-6ad3ac40ad09', '2f6d5461-16a5-4d63-8484-5e3dcb4e2e9e', 'bed39879-cbb7-414d-b71c-8b7f44e736c4', 'd62ecccd-dd62-4c0a-a494-a6d4057f9f3a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:56 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:56 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:56 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 1073741824" returned: 0 in 0.676s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:56 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 Apr 16 22:22:56 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:56 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.472s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:56 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Deleted volume successfully. Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-df0e8e56-4eb0-4bdd-afde-8edc7da1f3b6 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-2610072b-f7b5-4c78-a6aa-77d9e9332118-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-499d36b1-c561-4e73-a28f-f715b022c26a-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-499d36b1-c561-4e73-a28f-f715b022c26a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-quobyte-499d36b1-c561-4e73-a28f-f715b022c26a" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-499d36b1-c561-4e73-a28f-f715b022c26a" acquired by "delete_volume" :: waited 0.007s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2128bf-65a0-4311-8c62-0d84cbb6bd04]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:56 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a Apr 16 22:22:56 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:57 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4" returned: 0 in 0.547s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.213s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-36768955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b235eca0-1309-4b30-afc9-1771d81fddcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c839fdd6ed4d61bf11b5e3f6e9a7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:22:53Z,use_quota=True,user_id='c2f5867813e8495591c853d028380614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Creating volume b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:22:57 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c5638b-397e-4f53-a8f0-539ffff6e259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd08285d-c814-4106-8990-f4bb0b6943f4', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:57 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc 1073741824 Apr 16 22:22:57 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e19d1b-8733-4db1-bd32-4d31cc5da8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:22:57 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Volume volume-bd08285d-c814-4106-8990-f4bb0b6943f4 (bd08285d-c814-4106-8990-f4bb0b6943f4): created successfully Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e19d1b-8733-4db1-bd32-4d31cc5da8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Flow 'volume_create_manager' (040ede7d-20ca-40bf-8fd8-37376971d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:22:57 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-924c84b4-f6ab-402e-866b-b458cf0441ea tempest-CreateVolumesFromImageTest-136722499 None] Created volume successfully. Apr 16 22:22:57 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a" returned: 0 in 0.579s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:57 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a Apr 16 22:22:57 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:57 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc 1073741824" returned: 0 in 0.670s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:57 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:22:57 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:57 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-499d36b1-c561-4e73-a28f-f715b022c26a" returned: 0 in 0.527s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-499d36b1-c561-4e73-a28f-f715b022c26a" released by "delete_volume" :: held 1.135s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:57 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Created reservations ['eb26aeae-c64a-4118-978f-2e330032251c', '21296e94-210f-40aa-9f8f-05d012279305', '2e82c751-fbe9-44be-834e-b86b6ed73b10', 'c114669f-bd1f-4fec-9ab4-fe16b7d3680c'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:58 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:58 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-bd08285d-c814-4106-8990-f4bb0b6943f4-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-bd08285d-c814-4106-8990-f4bb0b6943f4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-quobyte-bd08285d-c814-4106-8990-f4bb0b6943f4" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-bd08285d-c814-4106-8990-f4bb0b6943f4" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef5bed-ac02-4fd8-aaf9-2574b9f498c4]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:58 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 0 in 0.513s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Attempting download of fc1a3fa2-bedc-4143-856a-42ade81658d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}])) to volume b235eca0-1309-4b30-afc9-1771d81fddcc. {{(pid=82650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 16 22:22:58 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 Apr 16 22:22:58 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cf4515-c56b-4120-ae9d-4b507a439ada]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ot5ghrtz {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:58 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ot5ghrtz Apr 16 22:22:58 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:58 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.603s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:58 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Deleted volume successfully. Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9a82e25e-7e3b-41cf-bc14-f84e65b9f6b5 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-499d36b1-c561-4e73-a28f-f715b022c26a-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:58 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4" returned: 0 in 0.558s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:58 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4 Apr 16 22:22:58 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:58 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ot5ghrtz" returned: 0 in 0.606s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ot5ghrtz {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-a2555849-2178-4474-a441-0470ecea824a-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-a2555849-2178-4474-a441-0470ecea824a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-quobyte-a2555849-2178-4474-a441-0470ecea824a" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-a2555849-2178-4474-a441-0470ecea824a" acquired by "delete_volume" :: waited 0.023s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:22:59 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ot5ghrtz Apr 16 22:22:59 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca8e3ef-b5d3-4672-b00c-5e686bb7c52c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:59 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a Apr 16 22:22:59 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:59 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bd08285d-c814-4106-8990-f4bb0b6943f4" returned: 0 in 0.496s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-bd08285d-c814-4106-8990-f4bb0b6943f4" released by "delete_volume" :: held 1.095s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Created reservations ['9120a3ee-ed90-4bd0-8dcf-e92cd1d38a35', '181e45e7-a0df-4029-bd8f-d651c8eba067', 'e2157f48-de93-4c20-9e8a-2860916c1520', '1536a8d2-ebb1-4d85-9949-1a2ab065c1ba'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:59 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:22:59 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:59 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ot5ghrtz" returned: 1 in 0.604s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc1a3fa2-bedc-4143-856a-42ade81658d5_ot5ghrtz' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[936be8eb-0b6a-4e8d-abd4-f1e15db56a99]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:59 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD Apr 16 22:22:59 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:59 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a" returned: 0 in 0.570s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:22:59 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a Apr 16 22:22:59 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:22:59 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.482s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:22:59 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Deleted volume successfully. Apr 16 22:22:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-dfed7873-3b00-4dcf-a182-8a2526a4389f tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-bd08285d-c814-4106-8990-f4bb0b6943f4-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:00 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a2555849-2178-4474-a441-0470ecea824a" returned: 0 in 0.456s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-a2555849-2178-4474-a441-0470ecea824a" released by "delete_volume" :: held 1.057s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Created reservations ['209ef3b8-eab7-4818-a937-59c3e7536c05', '6949cb20-b966-4114-b97b-28dd6a885445', 'a6307f2f-ddf7-47b8-85fe-6d1f4d82bf89', '4ad73e19-a6aa-4cba-aa74-6b399eaf8384'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:00 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] fc1a3fa2-bedc-4143-856a-42ade81658d5 was qcow2, converting to raw {{(pid=82650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:00 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:23:00 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:00 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:00 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-caa228b4-400b-4c46-bd0f-455f4d9459f7-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-caa228b4-400b-4c46-bd0f-455f4d9459f7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-quobyte-caa228b4-400b-4c46-bd0f-455f4d9459f7" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-caa228b4-400b-4c46-bd0f-455f4d9459f7" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ac9fdb-6418-4ea4-82c8-58320e46a447]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:00 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 Apr 16 22:23:00 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:00 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.590s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:00 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Deleted volume successfully. Apr 16 22:23:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-68a47461-f6d8-4f24-b647-025d995d902a tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-a2555849-2178-4474-a441-0470ecea824a-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:01 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7" returned: 0 in 0.704s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:01 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7 Apr 16 22:23:01 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-be55d10b-43dc-4a9a-b1f7-65b83acebe5a-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-be55d10b-43dc-4a9a-b1f7-65b83acebe5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-quobyte-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-quobyte-be55d10b-43dc-4a9a-b1f7-65b83acebe5a" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-be55d10b-43dc-4a9a-b1f7-65b83acebe5a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Deleting offline snapshot be55d10b-43dc-4a9a-b1f7-65b83acebe5a of volume fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] snapshot_file for this snap is: volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[86873552-fead-4b60-a221-e06edf1af7a7]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:01 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a Apr 16 22:23:01 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:01 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 0 in 1.475s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fc1a3fa2-bedc-4143-856a-42ade81658d5_c06fz23idevstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:23:01 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Converted 112.00 MB image at 75.81 MB/s Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:01 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc 1G Apr 16 22:23:01 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:01 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-caa228b4-400b-4c46-bd0f-455f4d9459f7" returned: 0 in 0.515s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-caa228b4-400b-4c46-bd0f-455f4d9459f7" released by "delete_volume" :: held 1.256s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Created reservations ['dd392c4c-7f20-4543-91b8-57913db521bf', '218b8eb2-2061-40e0-9fa7-582c72db7b3f', '8b614e8d-b68c-47b2-95e4-647bcfbfc44c', '7a895f38-b589-42c1-9e5d-371cdbf20d87'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:01 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:01 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:02 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc 1G" returned: 0 in 0.621s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:02 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a" returned: 0 in 0.979s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e437904d-bed5-4e62-9b04-e889a3db1944]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:02 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19982ca-ca0c-4f82-863e-b7597218644e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.534s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Deleted volume successfully. Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8cd82cbd-60c2-4cb4-9e2e-39a15de8b555 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-caa228b4-400b-4c46-bd0f-455f4d9459f7-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:02 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:23:02 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:02 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a Apr 16 22:23:02 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-quobyte-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[713dde7d-098c-446f-8ed0-0e52a3537350]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:02 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 Apr 16 22:23:02 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:02 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" returned: 0 in 0.549s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:02 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a Apr 16 22:23:02 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:03 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 0 in 0.730s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:03 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:23:03 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:03 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750" returned: 0 in 0.705s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:03 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750 Apr 16 22:23:03 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:03 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a" returned: 0 in 0.629s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:03 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a Apr 16 22:23:03 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:03 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 1 in 0.588s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Downloaded image fc1a3fa2-bedc-4143-856a-42ade81658d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}])) to volume b235eca0-1309-4b30-afc9-1771d81fddcc successfully. {{(pid=82650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Temporary image fc1a3fa2-bedc-4143-856a-42ade81658d5 for user c2f5867813e8495591c853d028380614 is deleted. {{(pid=82650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.volume.volume_utils [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Marking volume b235eca0-1309-4b30-afc9-1771d81fddcc as bootable. {{(pid=82650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Copying metadata from image fc1a3fa2-bedc-4143-856a-42ade81658d5 to b235eca0-1309-4b30-afc9-1771d81fddcc. {{(pid=82650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Creating volume glance metadata for volume b235eca0-1309-4b30-afc9-1771d81fddcc backed by image fc1a3fa2-bedc-4143-856a-42ade81658d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c91648-42d7-43e6-b533-873391d677c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b235eca0-1309-4b30-afc9-1771d81fddcc', 'volume_size': 1, 'image_id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc1a3fa2-bedc-4143-856a-42ade81658d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '223c6377e43848e9923e5fc0230cc097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc1a3fa2-bedc-4143-856a-42ade81658d5', 'created_at': datetime.datetime(2026, 4, 16, 20, 9, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc1a3fa2-bedc-4143-856a-42ade81658d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154abbd1-4245-4161-9781-2d0c6a819c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:03 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Volume volume-b235eca0-1309-4b30-afc9-1771d81fddcc (b235eca0-1309-4b30-afc9-1771d81fddcc): created successfully Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154abbd1-4245-4161-9781-2d0c6a819c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Flow 'volume_create_manager' (a6f2dfaf-e0bd-4eb3-b53d-a784c42b3e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:03 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f1dff400-6ca7-4562-b62b-6dfb8d1fe966 tempest-VolumesExtendTest-1885002401 None] Created volume successfully. Apr 16 22:23:03 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750" returned: 0 in 0.607s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750" released by "delete_volume" :: held 1.337s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:04 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a.be55d10b-43dc-4a9a-b1f7-65b83acebe5a" returned: 0 in 0.495s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Created reservations ['6e927af8-ca7f-4eaa-be14-cabe62935251', '24c3de8b-fcdf-4dd5-8041-851e216e2ab0', '5264938c-dc1b-4624-a5ae-7b4d8774ff29', '56abf52e-5bbd-4cfc-888d-71859a85c250'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-be55d10b-43dc-4a9a-b1f7-65b83acebe5a" released by "_delete_snapshot" :: held 2.741s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" released by "delete_snapshot" :: held 2.772s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Created reservations ['dd71695c-ce72-435a-ae46-5d165e49df0a', 'c081c4b8-97f5-463b-81f3-5afe0a667043', 'bf31b5e8-b6de-4ff7-9b15-7ea980ed387e', '79c86810-0cfd-4dbe-844b-f5c31c7117c8'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:04 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:04 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:04 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Delete snapshot completed successfully. Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-203ed08e-4de2-4981-b35e-38b1a795954e tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-be55d10b-43dc-4a9a-b1f7-65b83acebe5a-delete_snapshot" released by "delete_snapshot" :: held 2.933s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "cinder-quobyte-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dafea9-4bb2-44d9-9dee-2623a7471b14]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:04 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a Apr 16 22:23:04 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e1ab6-2ab1-4fba-a69b-4c601fe82765]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:04 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.637s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:04 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Deleted volume successfully. Apr 16 22:23:04 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:23:04 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ba4be578-36d1-4b63-a008-209dce867a27 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-ea3e27b1-5d1f-4891-bb1a-c1d35ce8d750-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-3238909c-709b-4f26-ae2b-bd3d374e9f3e-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-3238909c-709b-4f26-ae2b-bd3d374e9f3e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-quobyte-3238909c-709b-4f26-ae2b-bd3d374e9f3e" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-3238909c-709b-4f26-ae2b-bd3d374e9f3e" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc79715e-29cf-444e-821b-c2ab7b69a263]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:05 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e Apr 16 22:23:05 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:05 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" returned: 0 in 0.744s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:05 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a Apr 16 22:23:05 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:05 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 0 in 0.587s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:05 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:23:05 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:05 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e" returned: 0 in 0.628s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:05 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e Apr 16 22:23:05 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:05 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 1 in 0.525s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc 2G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:05 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" returned: 0 in 0.618s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc 2G" returned: 0 in 0.051s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.213s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-quobyte-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a" released by "delete_volume" :: held 1.404s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-0ddc9388-6f30-498f-b5af-c2596c3282c1 tempest-VolumesExtendTest-1885002401 None] Extend volume completed successfully. Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Created reservations ['89d67cdc-2855-4e74-a4f1-095b08080f8b', '44f4616d-a66d-4549-884c-7fe7ec258918', '537f0b82-bb2e-4635-9282-31f64645df00', '6202280b-0892-42fb-9a69-b5b3c2889652'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:06 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:06 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:06 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3238909c-709b-4f26-ae2b-bd3d374e9f3e" returned: 0 in 0.497s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-3238909c-709b-4f26-ae2b-bd3d374e9f3e" released by "delete_volume" :: held 1.156s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Created reservations ['22a95d13-57b4-4c7d-a5fe-be7fa68eb848', 'c8aa2494-5710-42d8-81b9-e50c88125dc1', '92e950f2-2efa-4c90-887c-2ba5f1ae67fc', 'cd89d1f5-ee26-46be-b262-cf2474654a3e'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:06 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:06 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:06 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.484s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:06 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Deleted volume successfully. Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-496fcf38-9846-44fa-8e5f-f1b3404c9428 tempest-CreateVolumesFromSnapshotTest-503231282 None] Lock "cinder-fddd6cd9-ca4a-43ec-8bcd-a0ea6c7ab86a-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:06 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.559s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:06 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Deleted volume successfully. Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-00aa8e50-cb36-4310-95f5-fd3f00ddaa15 tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-3238909c-709b-4f26-ae2b-bd3d374e9f3e-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "cinder-b235eca0-1309-4b30-afc9-1771d81fddcc-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-b235eca0-1309-4b30-afc9-1771d81fddcc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "cinder-quobyte-b235eca0-1309-4b30-afc9-1771d81fddcc" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-quobyte-b235eca0-1309-4b30-afc9-1771d81fddcc" acquired by "delete_volume" :: waited 0.025s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-00592e01-73ef-4837-aded-742ac3c0ccc9-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45f8c6-346a-4c8f-b1d6-51d16b40b3d8]: (4, 'raw') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-00592e01-73ef-4837-aded-742ac3c0ccc9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "cinder-quobyte-00592e01-73ef-4837-aded-742ac3c0ccc9" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-00592e01-73ef-4837-aded-742ac3c0ccc9" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c239fd-95fc-4390-bc72-a9ecd17374c3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:07 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:23:07 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:07 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 Apr 16 22:23:07 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:07 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 0 in 0.724s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:07 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9" returned: 0 in 0.703s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:07 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9 Apr 16 22:23:07 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:07 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:23:07 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:08 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 1 in 0.616s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc' failed. Not Retrying. {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:08 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-00592e01-73ef-4837-aded-742ac3c0ccc9" returned: 0 in 0.551s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-quobyte-00592e01-73ef-4837-aded-742ac3c0ccc9" released by "delete_volume" :: held 1.283s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:08 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc Apr 16 22:23:08 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Created reservations ['fdff0c4e-1798-498b-940f-2d67e656a12f', '7c7caad1-e662-4e87-97f6-c27af09fd25f', 'e88ee1e8-5046-4071-9748-5408c6a8ddc7', '0784eff3-af74-4f83-b0d6-df85152c1d68'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:08 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:08 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Flow 'volume_create_manager' (9d621f08-5e40-4102-be23-cf41c004aae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7d6d1f-1396-4347-a801-ef4f7f93d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7d6d1f-1396-4347-a801-ef4f7f93d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1545476220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bced11-8c24-4ddc-be7c-6e638c375055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba852a38d994131a68d675bc20dc0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:09Z,use_quota=True,user_id='a0b2ebb1b3834355acdc1b887e6ef1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49128f05-5496-422e-a18d-2bfd536f42eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49128f05-5496-422e-a18d-2bfd536f42eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a02e0d-eacd-47d1-9ffd-c19c3ad9ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a02e0d-eacd-47d1-9ffd-c19c3ad9ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89bced11-8c24-4ddc-be7c-6e638c375055', 'volume_name': 'volume-89bced11-8c24-4ddc-be7c-6e638c375055', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5472824a-8120-4104-b942-be9bfb38d479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5472824a-8120-4104-b942-be9bfb38d479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb19527-b8be-4525-a2c1-d14039ca8abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Volume 89bced11-8c24-4ddc-be7c-6e638c375055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89bced11-8c24-4ddc-be7c-6e638c375055', 'volume_size': 1} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1545476220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bced11-8c24-4ddc-be7c-6e638c375055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba852a38d994131a68d675bc20dc0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:09Z,use_quota=True,user_id='a0b2ebb1b3834355acdc1b887e6ef1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Creating volume 89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:23:09 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b235eca0-1309-4b30-afc9-1771d81fddcc" returned: 0 in 0.603s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:09 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 1073741824 Apr 16 22:23:09 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-quobyte-b235eca0-1309-4b30-afc9-1771d81fddcc" released by "delete_volume" :: held 2.024s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Created reservations ['ccce8157-9dc1-4487-83c3-24e277393644', '5cdeafcf-e616-47ee-a220-0e5a9a1e0390', '808f47cd-a960-4c30-9a6d-04023f1549f1', 'd009bab5-6785-43ed-933b-c8d7f68cfb75'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:09 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.597s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:09 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Deleted volume successfully. Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f811b3ac-a970-4a4f-a989-597ff4b8933a tempest-CreateVolumesFromImageTest-136722499 None] Lock "cinder-00592e01-73ef-4837-aded-742ac3c0ccc9-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:09 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:09 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:23:09 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Flow 'volume_create_manager' (a630653b-0a55-48ea-a21d-e173e5404fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d95373-65dc-4bd4-84d9-29884e119462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.585s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:09 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d95373-65dc-4bd4-84d9-29884e119462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1299982891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4857e78-12ce-425e-b00d-b54cef1a6d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c839fdd6ed4d61bf11b5e3f6e9a7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:10Z,use_quota=True,user_id='c2f5867813e8495591c853d028380614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc6582-22e3-4776-a26f-32b0e7225b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc6582-22e3-4776-a26f-32b0e7225b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fd3698-bb25-4eb8-9382-0c064668f70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fd3698-bb25-4eb8-9382-0c064668f70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4857e78-12ce-425e-b00d-b54cef1a6d03', 'volume_name': 'volume-c4857e78-12ce-425e-b00d-b54cef1a6d03', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08be2bb-e296-43d7-b473-9acdea94a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08be2bb-e296-43d7-b473-9acdea94a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e847012-1968-44f0-b7ef-df0c4d0dc0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:09 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Volume c4857e78-12ce-425e-b00d-b54cef1a6d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4857e78-12ce-425e-b00d-b54cef1a6d03', 'volume_size': 1} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:09 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Deleted volume successfully. Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 1073741824" returned: 0 in 0.789s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8a67f9e3-71c1-4827-ad88-c5a2bda47296 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-b235eca0-1309-4b30-afc9-1771d81fddcc-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:09 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 Apr 16 22:23:09 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:10 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055" returned: 0 in 0.584s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1299982891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4857e78-12ce-425e-b00d-b54cef1a6d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c839fdd6ed4d61bf11b5e3f6e9a7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:10Z,use_quota=True,user_id='c2f5867813e8495591c853d028380614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Creating volume c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:23:10 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb19527-b8be-4525-a2c1-d14039ca8abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89bced11-8c24-4ddc-be7c-6e638c375055', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321d5802-c309-4c53-bc9b-eda47ae305fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:10 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 1073741824 Apr 16 22:23:10 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:10 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Volume volume-89bced11-8c24-4ddc-be7c-6e638c375055 (89bced11-8c24-4ddc-be7c-6e638c375055): created successfully Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321d5802-c309-4c53-bc9b-eda47ae305fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Flow 'volume_create_manager' (9d621f08-5e40-4102-be23-cf41c004aae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:10 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2be850f5-0d98-4590-8ca0-e7ad4f198b54 tempest-VolumeDependencyTests-979854459 None] Created volume successfully. Apr 16 22:23:11 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 1073741824" returned: 0 in 0.732s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:11 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 Apr 16 22:23:11 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:11 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03" returned: 0 in 0.630s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.594s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Creating offline snapshot 7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce of volume 89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e847012-1968-44f0-b7ef-df0c4d0dc0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4857e78-12ce-425e-b00d-b54cef1a6d03', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4413aa70-65cb-41d2-84de-4d586c910497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac30f960-3211-4086-90fc-236589c55594]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:12 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Volume volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 (c4857e78-12ce-425e-b00d-b54cef1a6d03): created successfully Apr 16 22:23:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4413aa70-65cb-41d2-84de-4d586c910497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Flow 'volume_create_manager' (a630653b-0a55-48ea-a21d-e173e5404fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:12 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ad16741c-f797-4a8c-a224-dc52e2ed2bd5 tempest-VolumesExtendTest-1885002401 None] Created volume successfully. Apr 16 22:23:12 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 Apr 16 22:23:12 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:12 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055" returned: 0 in 0.693s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:12 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce 1G Apr 16 22:23:12 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:13 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce 1G" returned: 0 in 0.815s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89bced11-8c24-4ddc-be7c-6e638c375055 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:13 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89bced11-8c24-4ddc-be7c-6e638c375055 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce Apr 16 22:23:13 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:14 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89bced11-8c24-4ddc-be7c-6e638c375055 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" returned: 0 in 0.543s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:14 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce is being set with open permissions: ugo+rw Apr 16 22:23:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:14 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce Apr 16 22:23:14 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:14 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" returned: 0 in 0.492s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:14 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.info Apr 16 22:23:14 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:14 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.info" returned: 0 in 0.442s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:14 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.info is being set with open permissions: ugo+rw Apr 16 22:23:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:15 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.info Apr 16 22:23:15 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:15 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.info" returned: 0 in 0.532s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.593s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.245s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Creating offline snapshot cf4b866e-4663-45b2-95e1-a05a86896ba3 of volume c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:23:15 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-33ada8e9-7069-4b3c-a13f-9884557a6a97 tempest-VolumeDependencyTests-979854459 None] Create snapshot completed successfully Apr 16 22:23:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2da8db-2e30-4bb8-b457-ddffa29b5b3f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:15 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 Apr 16 22:23:15 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:16 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03" returned: 0 in 0.480s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:16 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 1G Apr 16 22:23:16 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:16 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 1G" returned: 0 in 0.614s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:16 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 Apr 16 22:23:16 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Flow 'volume_create_manager' (8064072c-7cfb-46a8-81fd-2b60172f9b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a64aea0-c447-42c3-ad61-7f76f80f2665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a64aea0-c447-42c3-ad61-7f76f80f2665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-430299970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bea1513-e64d-4bc5-96ca-eae0d4b161dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba852a38d994131a68d675bc20dc0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:17Z,use_quota=True,user_id='a0b2ebb1b3834355acdc1b887e6ef1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777088f2-1bd8-4c82-a835-003321e00754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777088f2-1bd8-4c82-a835-003321e00754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d1877e-5e7c-47bc-97ee-b9bafe6c0c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d1877e-5e7c-47bc-97ee-b9bafe6c0c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bea1513-e64d-4bc5-96ca-eae0d4b161dc', 'volume_name': 'volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc', 'volume_size': 1, 'snapshot_id': '7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47df394a-8eb9-4cfe-9944-08250858117f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47df394a-8eb9-4cfe-9944-08250858117f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edef6eb-882c-4b3b-8337-13d57b2766cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:16 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Volume 7bea1513-e64d-4bc5-96ca-eae0d4b161dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc', 'volume_size': 1, 'snapshot_id': '7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce'} Apr 16 22:23:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:17 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3" returned: 0 in 0.590s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:17 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 is being set with open permissions: ugo+rw Apr 16 22:23:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:17 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 Apr 16 22:23:17 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:17 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3" returned: 0 in 0.568s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:17 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.info Apr 16 22:23:17 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:18 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.info" returned: 0 in 0.603s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:18 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.info is being set with open permissions: ugo+rw Apr 16 22:23:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:18 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.info Apr 16 22:23:18 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:19 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.info" returned: 0 in 0.540s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.486s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.047s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" by "_create_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Creating volume 7bea1513-e64d-4bc5-96ca-eae0d4b161dc from snapshot 7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce {{(pid=82650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:19 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1679788a-8d85-4223-886b-3e608417b0dc tempest-VolumesExtendTest-1885002401 None] Create snapshot completed successfully Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] snapshot: 7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce, volume: 7bea1513-e64d-4bc5-96ca-eae0d4b161dc, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[84467017-f2a3-4a85-8b7f-42d9ef114f6a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:19 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce Apr 16 22:23:19 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-595b837b-f0f3-4d7b-a566-28ec4154ec50 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:19 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" returned: 0 in 0.541s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89bced11-8c24-4ddc-be7c-6e638c375055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a876d-3005-4236-8972-98ebaa74ff5a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:19 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 Apr 16 22:23:19 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:20 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055" returned: 0 in 0.628s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:20 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:23:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:20 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc Apr 16 22:23:20 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:22 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" returned: 0 in 2.356s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:22 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f58f500-40db-4bf9-81e9-26ca60cbccc3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:22 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 Apr 16 22:23:22 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:23 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055" returned: 0 in 0.643s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:23:23 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Converted 1024.00 MB image at 434.32 MB/s Apr 16 22:23:23 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc is being set with open permissions: ugo+rw Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:23 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc Apr 16 22:23:23 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:23 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" returned: 0 in 0.485s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" released by "_copy_volume_from_snapshot" :: held 4.733s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" released by "_create_volume_from_snapshot" :: held 4.769s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.801s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-595b837b-f0f3-4d7b-a566-28ec4154ec50 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.254s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa47dc5-d9f6-461c-9992-9ea3c02d489f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-595b837b-f0f3-4d7b-a566-28ec4154ec50 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edef6eb-882c-4b3b-8337-13d57b2766cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc', 'volume_size': 1, 'snapshot_id': '7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c53891-cf32-4d6c-b12b-3b5eb370e289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:23 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Volume volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc (7bea1513-e64d-4bc5-96ca-eae0d4b161dc): created successfully Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c53891-cf32-4d6c-b12b-3b5eb370e289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:23 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Flow 'volume_create_manager' (8064072c-7cfb-46a8-81fd-2b60172f9b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:23 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6c2863d9-8187-4146-87f8-0e0f15913b9a tempest-VolumeDependencyTests-979854459 None] Created volume successfully. Apr 16 22:23:23 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 Apr 16 22:23:23 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:24 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:24 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:24 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-595b837b-f0f3-4d7b-a566-28ec4154ec50 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03" returned: 0 in 0.673s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-595b837b-f0f3-4d7b-a566-28ec4154ec50 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 2G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-89bced11-8c24-4ddc-be7c-6e638c375055" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-89bced11-8c24-4ddc-be7c-6e638c375055" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Deleting offline snapshot 7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce of volume 89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] snapshot_file for this snap is: volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-595b837b-f0f3-4d7b-a566-28ec4154ec50 tempest-VolumesExtendTest-1885002401 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 2G" returned: 0 in 0.119s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-595b837b-f0f3-4d7b-a566-28ec4154ec50 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.821s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc9859-e6f9-4a6b-ab1b-aba49aa95deb]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:24 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-595b837b-f0f3-4d7b-a566-28ec4154ec50 tempest-VolumesExtendTest-1885002401 None] Extend volume completed successfully. Apr 16 22:23:24 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce Apr 16 22:23:24 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:25 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.704s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "cinder-cf4b866e-4663-45b2-95e1-a05a86896ba3-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-cf4b866e-4663-45b2-95e1-a05a86896ba3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "cinder-quobyte-c4857e78-12ce-425e-b00d-b54cef1a6d03" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-quobyte-c4857e78-12ce-425e-b00d-b54cef1a6d03" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "cinder-quobyte-cf4b866e-4663-45b2-95e1-a05a86896ba3" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-quobyte-cf4b866e-4663-45b2-95e1-a05a86896ba3" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Deleting offline snapshot cf4b866e-4663-45b2-95e1-a05a86896ba3 of volume c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] snapshot_file for this snap is: volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[49278b37-fcbf-444d-8a0d-58469709c48f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:25 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" returned: 0 in 0.776s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89bced11-8c24-4ddc-be7c-6e638c375055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc97785-7e4c-4f55-a3c0-054eea2db361]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:25 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 Apr 16 22:23:25 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:25 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 Apr 16 22:23:25 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:26 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3" returned: 0 in 0.699s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4857e78-12ce-425e-b00d-b54cef1a6d03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a371043-b04a-4a35-a3bb-4dd68a345198]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:26 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055" returned: 0 in 0.679s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:26 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce Apr 16 22:23:26 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:26 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 Apr 16 22:23:26 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:26 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03" returned: 0 in 0.615s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:26 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" returned: 0 in 0.609s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:26 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 Apr 16 22:23:26 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:26 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce Apr 16 22:23:26 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:27 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055.7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" returned: 0 in 0.468s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=153,cinder:UPDATE=197,cinder:INSERT=51,cinder:DELETE=20 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce" released by "_delete_snapshot" :: held 2.642s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-89bced11-8c24-4ddc-be7c-6e638c375055" released by "delete_snapshot" :: held 2.673s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:27 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3" returned: 0 in 0.583s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Created reservations ['23f7fc31-fbb7-44a1-9f0b-ba28b75bc75f', '182a43ed-cd7f-4341-9049-d2d313a7741d', 'c244be62-b5c3-481a-adac-4bef816fe687', '3bf4c7b5-3bea-4b14-bdd5-7ef13adda9c8'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:27 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3 Apr 16 22:23:27 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Delete snapshot completed successfully. Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d326e56e-8339-4d2f-b60f-cb32f1823018 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-7e90c78d-fb68-4f7f-8e13-dfcca2ffb7ce-delete_snapshot" released by "delete_snapshot" :: held 2.805s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-89bced11-8c24-4ddc-be7c-6e638c375055-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Lock "cinder-89bced11-8c24-4ddc-be7c-6e638c375055-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:27 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03.cf4b866e-4663-45b2-95e1-a05a86896ba3" returned: 0 in 0.479s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-quobyte-cf4b866e-4663-45b2-95e1-a05a86896ba3" released by "_delete_snapshot" :: held 2.477s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-89bced11-8c24-4ddc-be7c-6e638c375055" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-quobyte-c4857e78-12ce-425e-b00d-b54cef1a6d03" released by "delete_snapshot" :: held 2.495s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-89bced11-8c24-4ddc-be7c-6e638c375055" acquired by "delete_volume" :: waited 0.022s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[31029bc9-1375-4e5c-b27b-801378ca6c07]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Created reservations ['6c7fe402-2be2-4343-9d54-47b4a1b8cbc6', 'e8c8e8e0-20ab-42e3-9da9-ef6f72f760f1', '06765f0f-aaaa-4c8e-b74e-1fea4613cde6', '6648ebd5-462e-4780-b516-acc1e621f352'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Delete snapshot completed successfully. Apr 16 22:23:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6f5eeab5-b739-41e6-8d5f-7d3d1faecd23 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-cf4b866e-4663-45b2-95e1-a05a86896ba3-delete_snapshot" released by "delete_snapshot" :: held 2.631s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:27 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 Apr 16 22:23:27 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:28 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055" returned: 0 in 0.581s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:28 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055 Apr 16 22:23:28 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "cinder-c4857e78-12ce-425e-b00d-b54cef1a6d03-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-c4857e78-12ce-425e-b00d-b54cef1a6d03-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "cinder-quobyte-c4857e78-12ce-425e-b00d-b54cef1a6d03" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-quobyte-c4857e78-12ce-425e-b00d-b54cef1a6d03" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:28 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb8a93e-e024-4588-a194-d5f8cb157715]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:28 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 Apr 16 22:23:28 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:29 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-89bced11-8c24-4ddc-be7c-6e638c375055" returned: 0 in 0.570s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-89bced11-8c24-4ddc-be7c-6e638c375055" released by "delete_volume" :: held 1.188s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Created reservations ['91f0ebd2-7937-4553-b276-170f97bab5cf', '505ec205-a41b-47dd-911a-2e41f5287da7', 'a95619ed-7c46-4046-bb72-c0a9acfbf8f3', '468249cb-8a58-4d2a-b2a4-85af4b72bb03'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:29 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:29 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:29 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03" returned: 0 in 0.552s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:29 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03 Apr 16 22:23:29 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:29 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.465s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:29 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Deleted volume successfully. Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c7583dd-7c8a-4421-a675-2b8f094b46ac tempest-VolumeDependencyTests-979854459 None] Lock "cinder-89bced11-8c24-4ddc-be7c-6e638c375055-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:29 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-c4857e78-12ce-425e-b00d-b54cef1a6d03" returned: 0 in 0.483s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-quobyte-c4857e78-12ce-425e-b00d-b54cef1a6d03" released by "delete_volume" :: held 1.068s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Created reservations ['2dff20b6-96e8-41e3-9bac-a7b501f32fd9', '44920655-8835-4646-b589-825f6fc7c5b4', '0d28c314-d256-4d65-83ca-0746dbaa5d14', '11e2c797-d1f4-4488-a843-f94a800a1d12'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:29 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:29 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:30 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.420s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:30 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Deleted volume successfully. Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-08146779-4e09-43d4-b46e-a127996c37c9 tempest-VolumesExtendTest-1885002401 None] Lock "cinder-c4857e78-12ce-425e-b00d-b54cef1a6d03-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:UPDATE=235,cinder:SELECT=170,cinder:DELETE=19,cinder:INSERT=60 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Flow 'volume_create_manager' (de2b64e3-a51c-41ee-9eb9-1975f3ef4448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7b511f-c5d5-4364-aaab-ce5f913880fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7b511f-c5d5-4364-aaab-ce5f913880fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1881841987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf291096-5798-4dfe-be18-3acba215ef47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba852a38d994131a68d675bc20dc0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:30Z,use_quota=True,user_id='a0b2ebb1b3834355acdc1b887e6ef1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9427f048-0a02-4e1f-bac2-e7137e114162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9427f048-0a02-4e1f-bac2-e7137e114162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14383cf8-38ff-4110-a124-f0544d2226f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14383cf8-38ff-4110-a124-f0544d2226f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf291096-5798-4dfe-be18-3acba215ef47', 'volume_name': 'volume-cf291096-5798-4dfe-be18-3acba215ef47', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbdc17b-cdbe-48b9-9c41-f93dc4c0051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbdc17b-cdbe-48b9-9c41-f93dc4c0051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fe6292-f71d-44db-82de-0e8e0b55f9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:30 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Volume cf291096-5798-4dfe-be18-3acba215ef47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf291096-5798-4dfe-be18-3acba215ef47', 'volume_size': 1} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1881841987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf291096-5798-4dfe-be18-3acba215ef47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba852a38d994131a68d675bc20dc0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:30Z,use_quota=True,user_id='a0b2ebb1b3834355acdc1b887e6ef1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Creating volume cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:23:30 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:30 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 1073741824 Apr 16 22:23:30 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:30 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 1073741824" returned: 0 in 0.538s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:30 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 Apr 16 22:23:30 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:31 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47" returned: 0 in 0.473s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:31 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:23:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fe6292-f71d-44db-82de-0e8e0b55f9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf291096-5798-4dfe-be18-3acba215ef47', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f0ee97-3d86-464f-8bbb-3fcd0443b1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:31 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Volume volume-cf291096-5798-4dfe-be18-3acba215ef47 (cf291096-5798-4dfe-be18-3acba215ef47): created successfully Apr 16 22:23:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f0ee97-3d86-464f-8bbb-3fcd0443b1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Flow 'volume_create_manager' (de2b64e3-a51c-41ee-9eb9-1975f3ef4448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:31 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3967002e-bd9f-4063-8870-c261be44cc3b tempest-VolumeDependencyTests-979854459 None] Created volume successfully. Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Flow 'volume_create_manager' (2428c987-5e72-42b5-92c6-304e02052439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14e7113-cd22-449a-9293-ad7b7056051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14e7113-cd22-449a-9293-ad7b7056051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2106426334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755d42ff-4e63-4abd-9b1e-9e6235bc9b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18bf907b7654bfd97998ab406d11804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:33Z,use_quota=True,user_id='d63e5ec4a2454651982cce45f0d5d27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c449f62e-7c61-4567-8a27-f90b64a0b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c449f62e-7c61-4567-8a27-f90b64a0b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17025caa-b7ab-4df5-b125-ea97ee5cdd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17025caa-b7ab-4df5-b125-ea97ee5cdd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755d42ff-4e63-4abd-9b1e-9e6235bc9b9f', 'volume_name': 'volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda6b3f2-92f6-43c6-8a52-c59be8d69480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda6b3f2-92f6-43c6-8a52-c59be8d69480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337b4f59-8383-480b-bf08-648f94fe49af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Volume 755d42ff-4e63-4abd-9b1e-9e6235bc9b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f', 'volume_size': 1} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2106426334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755d42ff-4e63-4abd-9b1e-9e6235bc9b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18bf907b7654bfd97998ab406d11804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:33Z,use_quota=True,user_id='d63e5ec4a2454651982cce45f0d5d27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Creating volume 755d42ff-4e63-4abd-9b1e-9e6235bc9b9f {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:23:32 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:32 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f 1073741824 Apr 16 22:23:32 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Flow 'volume_create_manager' (d3cf4fa0-b244-4e43-9be3-33fe2ba3434b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066bd8a3-67b6-4ce0-ab38-2a52f6c9ade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066bd8a3-67b6-4ce0-ab38-2a52f6c9ade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1077428930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbca5dcc-3263-4e53-a8ca-8263a48050a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba852a38d994131a68d675bc20dc0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cf291096-5798-4dfe-be18-3acba215ef47,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:33Z,use_quota=True,user_id='a0b2ebb1b3834355acdc1b887e6ef1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1195cb2-50ca-4895-a834-57c9218f4ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1195cb2-50ca-4895-a834-57c9218f4ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0985a525-3552-4eb0-a940-3d12413df897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0985a525-3552-4eb0-a940-3d12413df897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bbca5dcc-3263-4e53-a8ca-8263a48050a8', 'volume_name': 'volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8', 'volume_size': 1, 'source_volid': 'cf291096-5798-4dfe-be18-3acba215ef47', 'source_volstatus': 'available'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5219b9-7670-441d-b80d-5034e7bbe8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5219b9-7670-441d-b80d-5034e7bbe8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63105523-4d81-46aa-be00-f2ef25863786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Volume bbca5dcc-3263-4e53-a8ca-8263a48050a8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8', 'volume_size': 1, 'source_volid': 'cf291096-5798-4dfe-be18-3acba215ef47', 'source_volstatus': 'available'} Apr 16 22:23:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:33 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f 1073741824" returned: 0 in 0.506s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:33 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f Apr 16 22:23:33 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:33 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f" returned: 0 in 0.456s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.855s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:33 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Cloning volume cf291096-5798-4dfe-be18-3acba215ef47 to volume bbca5dcc-3263-4e53-a8ca-8263a48050a8 Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337b4f59-8383-480b-bf08-648f94fe49af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41708db-5568-4b77-995c-7a10dabee897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:33 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Volume volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f (755d42ff-4e63-4abd-9b1e-9e6235bc9b9f): created successfully Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41708db-5568-4b77-995c-7a10dabee897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Flow 'volume_create_manager' (2428c987-5e72-42b5-92c6-304e02052439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Creating offline snapshot 2f67b17a-0750-40b4-8334-2e617cfb2a8b of volume cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:23:33 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c222d510-ccc9-4a42-95b4-f5af44a515e1 tempest-VolumesNegativeTest-1293401022 None] Created volume successfully. Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7154f3dd-51f0-4851-892a-329f5c864498]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:33 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 Apr 16 22:23:33 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:34 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47" returned: 0 in 0.511s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:34 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b 1G Apr 16 22:23:34 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:35 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b 1G" returned: 0 in 0.822s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf291096-5798-4dfe-be18-3acba215ef47 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:35 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf291096-5798-4dfe-be18-3acba215ef47 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b Apr 16 22:23:35 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:35 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf291096-5798-4dfe-be18-3acba215ef47 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b" returned: 0 in 0.623s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:35 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b is being set with open permissions: ugo+rw Apr 16 22:23:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:35 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b Apr 16 22:23:35 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:36 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b" returned: 0 in 0.463s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:36 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.info Apr 16 22:23:36 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:36 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.info" returned: 0 in 0.530s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:36 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.info is being set with open permissions: ugo+rw Apr 16 22:23:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:36 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.info Apr 16 22:23:36 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:37 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.info" returned: 0 in 0.430s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-bbca5dcc-3263-4e53-a8ca-8263a48050a8" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-bbca5dcc-3263-4e53-a8ca-8263a48050a8" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] snapshot: 2f67b17a-0750-40b4-8334-2e617cfb2a8b, volume: bbca5dcc-3263-4e53-a8ca-8263a48050a8, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff46577b-a49a-4432-b1b5-2bf9d86d43a1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:37 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b Apr 16 22:23:37 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:37 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b" returned: 0 in 0.604s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf291096-5798-4dfe-be18-3acba215ef47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[903002ff-6d7c-424a-940b-1f62ac7b9c32]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:37 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 Apr 16 22:23:37 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:38 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47" returned: 0 in 0.522s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:38 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:23:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:38 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 Apr 16 22:23:38 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:41 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8" returned: 0 in 2.769s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:41 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c649c73-4007-4287-8547-5b362b876a54]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:41 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 Apr 16 22:23:41 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:41 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47" returned: 0 in 0.793s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:41 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47, size 1024.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:23:41 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Converted 1024.00 MB image at 369.60 MB/s Apr 16 22:23:41 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 is being set with open permissions: ugo+rw Apr 16 22:23:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:42 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 Apr 16 22:23:42 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:42 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8" returned: 0 in 0.569s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-bbca5dcc-3263-4e53-a8ca-8263a48050a8" released by "_copy_volume_from_snapshot" :: held 5.316s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-2f67b17a-0750-40b4-8334-2e617cfb2a8b" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:42 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-2f67b17a-0750-40b4-8334-2e617cfb2a8b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Deleting offline snapshot 2f67b17a-0750-40b4-8334-2e617cfb2a8b of volume cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:23:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] snapshot_file for this snap is: volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:23:42 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c47d44-bbcb-4696-b301-c497b182428b]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:42 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b Apr 16 22:23:42 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:43 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b" returned: 0 in 0.585s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf291096-5798-4dfe-be18-3acba215ef47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:23:43 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[97268792-6f31-47d9-a04f-afabfb05c9ed]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:43 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 Apr 16 22:23:43 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:43 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47" returned: 0 in 0.598s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:43 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b Apr 16 22:23:43 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:44 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b" returned: 0 in 0.476s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:44 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b Apr 16 22:23:44 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:44 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47.2f67b17a-0750-40b4-8334-2e617cfb2a8b" returned: 0 in 0.445s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-2f67b17a-0750-40b4-8334-2e617cfb2a8b" released by "_delete_snapshot" :: held 2.165s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.086s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63105523-4d81-46aa-be00-f2ef25863786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8', 'volume_size': 1, 'source_volid': 'cf291096-5798-4dfe-be18-3acba215ef47', 'source_volstatus': 'available'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d448641-a7b5-4cf2-8376-86c3294a34b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:44 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Volume volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 (bbca5dcc-3263-4e53-a8ca-8263a48050a8): created successfully Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d448641-a7b5-4cf2-8376-86c3294a34b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:44 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Flow 'volume_create_manager' (d3cf4fa0-b244-4e43-9be3-33fe2ba3434b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:44 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6d2a1315-c64e-49c7-bf80-23168a9d6325 tempest-VolumeDependencyTests-979854459 None] Created volume successfully. Apr 16 22:23:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-cf291096-5798-4dfe-be18-3acba215ef47-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Lock "cinder-cf291096-5798-4dfe-be18-3acba215ef47-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-cf291096-5798-4dfe-be18-3acba215ef47" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-cf291096-5798-4dfe-be18-3acba215ef47" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:45 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aebf7b-dd2c-4b0b-839b-3c69972f68ac]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:45 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 Apr 16 22:23:45 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:46 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47" returned: 0 in 0.602s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:46 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47 Apr 16 22:23:46 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:46 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cf291096-5798-4dfe-be18-3acba215ef47" returned: 0 in 0.494s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-cf291096-5798-4dfe-be18-3acba215ef47" released by "delete_volume" :: held 1.138s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Created reservations ['c4f61a15-71c0-4f82-bb5a-b54c2d4b6504', '917de2cb-91d4-4f98-b47d-1476cf0ca807', 'b2048623-5d65-4a3e-9334-c1ef84960839', '88356872-c52c-4445-a40c-070f5401e50b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:46 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:46 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:47 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.538s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:47 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Deleted volume successfully. Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3fee20a0-8614-44ce-adc4-13949ca6217f tempest-VolumeDependencyTests-979854459 None] Lock "cinder-cf291096-5798-4dfe-be18-3acba215ef47-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-bbca5dcc-3263-4e53-a8ca-8263a48050a8-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Lock "cinder-bbca5dcc-3263-4e53-a8ca-8263a48050a8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-bbca5dcc-3263-4e53-a8ca-8263a48050a8" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-bbca5dcc-3263-4e53-a8ca-8263a48050a8" acquired by "delete_volume" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0516fb23-6d99-4dc5-8e12-4fc73f95f846]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:47 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 Apr 16 22:23:47 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:48 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8" returned: 0 in 0.582s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:48 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8 Apr 16 22:23:48 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:48 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-bbca5dcc-3263-4e53-a8ca-8263a48050a8" returned: 0 in 0.597s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-bbca5dcc-3263-4e53-a8ca-8263a48050a8" released by "delete_volume" :: held 1.223s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:48 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Created reservations ['30946902-1055-4a1f-8707-a97e08a20f8e', '131fa62e-94d9-4a0b-8774-73b66086a3d3', '81e0b195-f2a1-41c3-84c6-0b8e56bbe0fd', 'f6c70a9c-f271-4827-a6fc-399dbbd3df43'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:49 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:49 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:49 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.476s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Deleted volume successfully. Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8075cf6e-06de-44a3-add6-5e48558edf8d tempest-VolumeDependencyTests-979854459 None] Lock "cinder-bbca5dcc-3263-4e53-a8ca-8263a48050a8-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-7bea1513-e64d-4bc5-96ca-eae0d4b161dc-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-7bea1513-e64d-4bc5-96ca-eae0d4b161dc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "cinder-quobyte-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:23:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:23:50 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14589ea-a79f-4e84-abf3-abcd1a098135]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:50 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc Apr 16 22:23:50 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:50 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" returned: 0 in 0.548s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:50 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc Apr 16 22:23:50 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:51 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" returned: 0 in 0.547s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-quobyte-7bea1513-e64d-4bc5-96ca-eae0d4b161dc" released by "delete_volume" :: held 1.144s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Created reservations ['8525abf5-cb70-4277-8cf6-8acd0c86cdf5', 'c14d307a-4847-4b1c-8c3a-a4332ef99ab2', '3fe94443-c65e-4f24-84c9-b10c528f8d48', '8a8f7c97-2f9d-4520-bff8-0851c71ed1e8'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:51 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:23:51 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:51 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.529s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:23:51 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Deleted volume successfully. Apr 16 22:23:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ed0e49f7-0dbb-4718-9ace-1e9d338d60e1 tempest-VolumeDependencyTests-979854459 None] Lock "cinder-7bea1513-e64d-4bc5-96ca-eae0d4b161dc-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Flow 'volume_create_manager' (bd38da2d-05df-451b-b03d-200ad4c3a86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75b2925-29c7-4053-9e8a-8cfa4a7cfb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75b2925-29c7-4053-9e8a-8cfa4a7cfb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7431a7-2440-4dc5-90f9-67b5b6789366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49c29e2b1644a15b73a0414bd56a4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:54Z,use_quota=True,user_id='374112ce94d5440bb9836c70934f6860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731a7bbd-4c49-4dda-81ac-b70818705a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731a7bbd-4c49-4dda-81ac-b70818705a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39690608-cdec-4174-acb9-e075ce989a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39690608-cdec-4174-acb9-e075ce989a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7431a7-2440-4dc5-90f9-67b5b6789366', 'volume_name': 'volume-3b7431a7-2440-4dc5-90f9-67b5b6789366', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71543c6c-5044-4294-bd15-32312e13acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71543c6c-5044-4294-bd15-32312e13acda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e97398-e4ff-47f8-a00a-045e16e524b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:54 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Volume 3b7431a7-2440-4dc5-90f9-67b5b6789366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7431a7-2440-4dc5-90f9-67b5b6789366', 'volume_size': 1} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7431a7-2440-4dc5-90f9-67b5b6789366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49c29e2b1644a15b73a0414bd56a4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:54Z,use_quota=True,user_id='374112ce94d5440bb9836c70934f6860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Creating volume 3b7431a7-2440-4dc5-90f9-67b5b6789366 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:23:54 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:54 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 1073741824 Apr 16 22:23:54 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:54 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 1073741824" returned: 0 in 0.558s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:54 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 Apr 16 22:23:54 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:55 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366" returned: 0 in 0.485s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:23:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e97398-e4ff-47f8-a00a-045e16e524b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7431a7-2440-4dc5-90f9-67b5b6789366', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f19307-665b-410f-81d2-56fd93d8ced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:55 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Volume volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 (3b7431a7-2440-4dc5-90f9-67b5b6789366): created successfully Apr 16 22:23:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f19307-665b-410f-81d2-56fd93d8ced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Flow 'volume_create_manager' (bd38da2d-05df-451b-b03d-200ad4c3a86a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-93af6bdb-fedd-4ab9-99a6-fc4c0a4d5b6a tempest-CinderUnicodeTest-736744972 None] Created volume successfully. Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Flow 'volume_create_manager' (0dfac9fc-95aa-43b7-b21b-1b4a0ef89d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cd7858-2112-43a2-87ad-4b0d71fda01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cd7858-2112-43a2-87ad-4b0d71fda01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-879735762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0db980-d97b-48bc-8741-79fba9c1e37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49c29e2b1644a15b73a0414bd56a4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:57Z,use_quota=True,user_id='374112ce94d5440bb9836c70934f6860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57515c6e-0254-48af-a660-2e8844117371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57515c6e-0254-48af-a660-2e8844117371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610635fb-fd0e-491c-b193-b0aeb39b262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610635fb-fd0e-491c-b193-b0aeb39b262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0db980-d97b-48bc-8741-79fba9c1e37f', 'volume_name': 'volume-8f0db980-d97b-48bc-8741-79fba9c1e37f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e533dc-88e1-4615-872f-100abe29dc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e533dc-88e1-4615-872f-100abe29dc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207ddaac-0a5e-406f-96a9-e8be4bf33310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:56 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Volume 8f0db980-d97b-48bc-8741-79fba9c1e37f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0db980-d97b-48bc-8741-79fba9c1e37f', 'volume_size': 1} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:23:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-879735762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0db980-d97b-48bc-8741-79fba9c1e37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49c29e2b1644a15b73a0414bd56a4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:23:57Z,use_quota=True,user_id='374112ce94d5440bb9836c70934f6860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Creating volume 8f0db980-d97b-48bc-8741-79fba9c1e37f {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:23:56 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:23:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:56 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f 1073741824 Apr 16 22:23:56 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:57 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f 1073741824" returned: 0 in 0.566s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:57 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f Apr 16 22:23:57 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:57 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f" returned: 0 in 0.509s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207ddaac-0a5e-406f-96a9-e8be4bf33310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0db980-d97b-48bc-8741-79fba9c1e37f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5f3586-4352-4e71-a507-e8dd9d0389e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:23:57 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Volume volume-8f0db980-d97b-48bc-8741-79fba9c1e37f (8f0db980-d97b-48bc-8741-79fba9c1e37f): created successfully Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5f3586-4352-4e71-a507-e8dd9d0389e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:23:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Flow 'volume_create_manager' (0dfac9fc-95aa-43b7-b21b-1b4a0ef89d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:23:57 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6f087026-7741-4f5a-861a-61e4d4e2c5a9 tempest-CinderUnicodeTest-736744972 None] Created volume successfully. Apr 16 22:23:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:23:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:23:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Creating offline snapshot d8988002-3804-464b-893d-f11e7071862f of volume 8f0db980-d97b-48bc-8741-79fba9c1e37f {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:23:59 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb7f800-6058-40d2-9a7a-1c51eb9b01b5]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:23:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:59 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f Apr 16 22:23:59 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:23:59 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 16 22:23:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f" returned: 0 in 0.572s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:23:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:23:59 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f 1G Apr 16 22:23:59 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:00 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f 1G" returned: 0 in 0.664s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0db980-d97b-48bc-8741-79fba9c1e37f -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:00 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0db980-d97b-48bc-8741-79fba9c1e37f -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f Apr 16 22:24:00 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:00 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0db980-d97b-48bc-8741-79fba9c1e37f -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f" returned: 0 in 0.596s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:00 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f is being set with open permissions: ugo+rw Apr 16 22:24:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:00 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f Apr 16 22:24:00 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:01 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f" returned: 0 in 0.667s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:01 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.info Apr 16 22:24:01 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:02 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.info" returned: 0 in 0.528s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:02 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.info is being set with open permissions: ugo+rw Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:02 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.info Apr 16 22:24:02 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Acquiring lock "cinder-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Lock "cinder-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Acquiring lock "cinder-quobyte-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Lock "cinder-quobyte-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f" acquired by "delete_volume" :: waited 0.007s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0162f0a1-aed8-4415-b49e-a82eb05843b2]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:02 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f Apr 16 22:24:02 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:02 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.info" returned: 0 in 0.485s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.592s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c1a199da-3a12-4a4d-a3ea-93940604814e tempest-CinderUnicodeTest-736744972 None] Create snapshot completed successfully Apr 16 22:24:03 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f" returned: 0 in 0.485s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:03 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f Apr 16 22:24:03 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Acquiring lock "cinder-d8988002-3804-464b-893d-f11e7071862f-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Lock "cinder-d8988002-3804-464b-893d-f11e7071862f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Acquiring lock "cinder-quobyte-8f0db980-d97b-48bc-8741-79fba9c1e37f" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Lock "cinder-quobyte-8f0db980-d97b-48bc-8741-79fba9c1e37f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Acquiring lock "cinder-quobyte-d8988002-3804-464b-893d-f11e7071862f" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Lock "cinder-quobyte-d8988002-3804-464b-893d-f11e7071862f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Deleting offline snapshot d8988002-3804-464b-893d-f11e7071862f of volume 8f0db980-d97b-48bc-8741-79fba9c1e37f {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] snapshot_file for this snap is: volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a69aae1-3727-4054-a6d8-2496e20e2c13]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:03 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f Apr 16 22:24:03 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:03 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f" returned: 0 in 0.449s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Lock "cinder-quobyte-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f" released by "delete_volume" :: held 0.958s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Created reservations ['3fe3889b-d771-45e8-956c-46d3e71996f8', '3bf4a88e-265c-4114-b102-aa564746ebdd', '5fe7098f-a724-4951-ad97-896ba929d3b8', 'f450624d-8e3a-4bb9-a069-f0030a88b288'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:03 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:03 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:03 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f" returned: 0 in 0.508s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0db980-d97b-48bc-8741-79fba9c1e37f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0234185-c68f-4bd4-911c-43dbf448ee2c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:03 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f Apr 16 22:24:03 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:04 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.453s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:04 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:04 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Deleted volume successfully. Apr 16 22:24:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ff30e001-edcc-44de-96a9-df77fbc48bb4 tempest-VolumesNegativeTest-1293401022 None] Lock "cinder-755d42ff-4e63-4abd-9b1e-9e6235bc9b9f-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:04 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f" returned: 0 in 0.527s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:04 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f Apr 16 22:24:04 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:04 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f" returned: 0 in 0.539s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:04 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f Apr 16 22:24:04 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:05 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f.d8988002-3804-464b-893d-f11e7071862f" returned: 0 in 0.520s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Lock "cinder-quobyte-d8988002-3804-464b-893d-f11e7071862f" released by "_delete_snapshot" :: held 2.167s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Lock "cinder-quobyte-8f0db980-d97b-48bc-8741-79fba9c1e37f" released by "delete_snapshot" :: held 2.186s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:05 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Created reservations ['39554c5b-0461-48e3-b874-aa7ed9dc79ce', '0d399bcb-2255-4a3b-978d-5f4570e39ea0', 'a65f07d9-145a-4a8b-a5cf-0fb52df5514a', 'b507bcf3-5bf1-4776-b1cf-1dca3ed22349'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Delete snapshot completed successfully. Apr 16 22:24:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-58b8e65c-f612-4ee5-9013-965082094fda tempest-CinderUnicodeTest-736744972 None] Lock "cinder-d8988002-3804-464b-893d-f11e7071862f-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Acquiring lock "cinder-8f0db980-d97b-48bc-8741-79fba9c1e37f-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Lock "cinder-8f0db980-d97b-48bc-8741-79fba9c1e37f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Acquiring lock "cinder-quobyte-8f0db980-d97b-48bc-8741-79fba9c1e37f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Lock "cinder-quobyte-8f0db980-d97b-48bc-8741-79fba9c1e37f" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[91406539-74ab-49b6-b782-01bffbfdef10]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (02917649-453a-4fc8-a1c7-18d3a5c4f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:06 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f Apr 16 22:24:06 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c684772-0227-4649-9cdb-e2c1ca04fc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c684772-0227-4649-9cdb-e2c1ca04fc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852548768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:07Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5d3518-73d6-4e2a-834d-90e323394109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5d3518-73d6-4e2a-834d-90e323394109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd518a49-448d-47bf-9861-955fe94f6e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd518a49-448d-47bf-9861-955fe94f6e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f', 'volume_name': 'volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f243ed-2124-44b9-a07d-0ff0ba68424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f243ed-2124-44b9-a07d-0ff0ba68424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72437bcd-1a99-43ab-8aa8-fb4a90c27a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:06 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f', 'volume_size': 1} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852548768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:07Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Creating volume a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:06 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:06 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f 1073741824 Apr 16 22:24:06 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:07 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f" returned: 0 in 0.558s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:07 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f Apr 16 22:24:07 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:07 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f 1073741824" returned: 0 in 0.620s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:07 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f Apr 16 22:24:07 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:07 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-8f0db980-d97b-48bc-8741-79fba9c1e37f" returned: 0 in 0.515s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Lock "cinder-quobyte-8f0db980-d97b-48bc-8741-79fba9c1e37f" released by "delete_volume" :: held 1.128s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Created reservations ['687795e8-ad56-4be6-9499-08beecfe2db6', '082ee159-e6cc-4b1e-8fb3-b9b076dec9b0', 'c0b020aa-d57d-4102-a140-b009e356c619', 'a2196d13-a884-4b7e-bb73-a0208d5a6cc5'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:07 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:07 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:07 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f" returned: 0 in 0.481s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72437bcd-1a99-43ab-8aa8-fb4a90c27a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626aa439-d7ae-477c-8184-808f04c275de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:08 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f (a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f): created successfully Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626aa439-d7ae-477c-8184-808f04c275de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (02917649-453a-4fc8-a1c7-18d3a5c4f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1563a50d-e5db-4d6f-8d25-f0c1ee64bc7e tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created volume successfully. Apr 16 22:24:08 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.414s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Deleted volume successfully. Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7a06fae1-c347-4c99-afcc-64ab0e8aaa63 tempest-CinderUnicodeTest-736744972 None] Lock "cinder-8f0db980-d97b-48bc-8741-79fba9c1e37f-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Acquiring lock "cinder-3b7431a7-2440-4dc5-90f9-67b5b6789366-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Lock "cinder-3b7431a7-2440-4dc5-90f9-67b5b6789366-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Acquiring lock "cinder-quobyte-3b7431a7-2440-4dc5-90f9-67b5b6789366" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Lock "cinder-quobyte-3b7431a7-2440-4dc5-90f9-67b5b6789366" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d308ab46-f7cc-4060-9fb0-9c71fd42824e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:08 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 Apr 16 22:24:09 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (be001700-6744-457b-95f7-4727d1e0295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee97b993-e0d4-467d-a9de-12941b72c864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee97b993-e0d4-467d-a9de-12941b72c864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694108975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ae4662-e7e8-4644-b5b0-1d54800803a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:09Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b50dc2-34a4-4df9-b2ab-2ba72d5dbcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b50dc2-34a4-4df9-b2ab-2ba72d5dbcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e03bc1-92bf-497e-b62a-e4c51af3dfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e03bc1-92bf-497e-b62a-e4c51af3dfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ae4662-e7e8-4644-b5b0-1d54800803a0', 'volume_name': 'volume-55ae4662-e7e8-4644-b5b0-1d54800803a0', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960442bc-da06-4634-a932-4ac414401350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960442bc-da06-4634-a932-4ac414401350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86842990-d891-4d1d-98a9-9d7a1dadb9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume 55ae4662-e7e8-4644-b5b0-1d54800803a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ae4662-e7e8-4644-b5b0-1d54800803a0', 'volume_size': 1} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694108975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ae4662-e7e8-4644-b5b0-1d54800803a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:09Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Creating volume 55ae4662-e7e8-4644-b5b0-1d54800803a0 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:09 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:09 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 1073741824 Apr 16 22:24:09 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (1aec549f-8cff-409f-a383-7d24bbf8e8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d602f53-106c-4722-adbe-4affba2ef7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d602f53-106c-4722-adbe-4affba2ef7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494117895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75c9d80-1863-4cbf-bc19-71407053392b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:09Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b10f22-e3de-4ea3-bc64-6c1d900dfa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b10f22-e3de-4ea3-bc64-6c1d900dfa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d51bac6-b971-4904-b35f-60c8ea4a5213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d51bac6-b971-4904-b35f-60c8ea4a5213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75c9d80-1863-4cbf-bc19-71407053392b', 'volume_name': 'volume-b75c9d80-1863-4cbf-bc19-71407053392b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f6f15f-5ce5-4434-b66d-b9f6c429dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f6f15f-5ce5-4434-b66d-b9f6c429dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a4b5ac-1e06-4336-b735-3cef00e03557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume b75c9d80-1863-4cbf-bc19-71407053392b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75c9d80-1863-4cbf-bc19-71407053392b', 'volume_size': 1} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:09 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366" returned: 0 in 0.839s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:09 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366 Apr 16 22:24:09 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (5f16c385-756a-4058-b4fb-ef04b33dfea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc148a1-25ad-42ad-9d0e-acf0a2bab7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc148a1-25ad-42ad-9d0e-acf0a2bab7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535506351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3155ac1f-ff9c-45b6-b09b-e3c7b786b10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:10Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913477dd-f877-4ec9-a8d4-e9eabadb6616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913477dd-f877-4ec9-a8d4-e9eabadb6616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d4be60-9945-4a64-97e8-13b629ad896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d4be60-9945-4a64-97e8-13b629ad896a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3155ac1f-ff9c-45b6-b09b-e3c7b786b10f', 'volume_name': 'volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64bb3899-2a5d-4485-bddc-1052b59b850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64bb3899-2a5d-4485-bddc-1052b59b850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918961c9-3391-43b2-a6ee-3d60bfbbe337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:09 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume 3155ac1f-ff9c-45b6-b09b-e3c7b786b10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f', 'volume_size': 1} Apr 16 22:24:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:10 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 1073741824" returned: 0 in 0.803s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:10 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 Apr 16 22:24:10 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (923a9a9d-ffe2-4928-9087-0dc26aa70469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aeb6945-a32e-427b-8ba9-a39807036753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aeb6945-a32e-427b-8ba9-a39807036753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586544189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5360fa8-df81-498f-968b-7684f75d3b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:10Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af429c9-af64-40b1-9ec9-5001198c5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af429c9-af64-40b1-9ec9-5001198c5295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1638bd6d-f6d8-4f5b-a111-e0ca8849ce53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1638bd6d-f6d8-4f5b-a111-e0ca8849ce53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5360fa8-df81-498f-968b-7684f75d3b3b', 'volume_name': 'volume-d5360fa8-df81-498f-968b-7684f75d3b3b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1836ceaa-5169-47be-8ce7-07d931655dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1836ceaa-5169-47be-8ce7-07d931655dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8aaa98-f960-4162-b39b-a08d7cc25798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume d5360fa8-df81-498f-968b-7684f75d3b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5360fa8-df81-498f-968b-7684f75d3b3b', 'volume_size': 1} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:10 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3b7431a7-2440-4dc5-90f9-67b5b6789366" returned: 0 in 0.699s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Lock "cinder-quobyte-3b7431a7-2440-4dc5-90f9-67b5b6789366" released by "delete_volume" :: held 1.573s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (48fd706c-9008-4b44-9b72-565e0c67e4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814370b2-9da1-4fa9-9f54-276f33a654f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Created reservations ['45ea2066-ddbc-4b84-b271-3c03f30bfed8', '1a0a39f8-6474-41f3-b984-08da683f2a05', '78299f2e-f880-4165-b684-7862d8dee533', '3484c253-e57e-4b11-9c4c-640a66d86214'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814370b2-9da1-4fa9-9f54-276f33a654f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-823664849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792e7934-4e64-4621-b34e-cc512f5a8528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:10Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794141b0-05c1-4bf7-9186-374132b00a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794141b0-05c1-4bf7-9186-374132b00a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a48b18-f723-4f8b-a4ad-5240264625e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a48b18-f723-4f8b-a4ad-5240264625e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792e7934-4e64-4621-b34e-cc512f5a8528', 'volume_name': 'volume-792e7934-4e64-4621-b34e-cc512f5a8528', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02db825d-d5b2-4fc9-9111-05b24ac74cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02db825d-d5b2-4fc9-9111-05b24ac74cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d611bd-1467-47fe-a240-aed6a26506e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume 792e7934-4e64-4621-b34e-cc512f5a8528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792e7934-4e64-4621-b34e-cc512f5a8528', 'volume_size': 1} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:10 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:10 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:10 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0" returned: 0 in 0.533s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494117895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75c9d80-1863-4cbf-bc19-71407053392b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:09Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Creating volume b75c9d80-1863-4cbf-bc19-71407053392b {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:10 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:10 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b 1073741824 Apr 16 22:24:10 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86842990-d891-4d1d-98a9-9d7a1dadb9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ae4662-e7e8-4644-b5b0-1d54800803a0', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7547dcc8-3fc9-4f25-b664-28849b257ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:10 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 (55ae4662-e7e8-4644-b5b0-1d54800803a0): created successfully Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7547dcc8-3fc9-4f25-b664-28849b257ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (be001700-6744-457b-95f7-4727d1e0295a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:10 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8b1281aa-7a0d-4b3d-b2e9-1d91d1e5e02d tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created volume successfully. Apr 16 22:24:11 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.490s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Deleted volume successfully. Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d7d4ef9e-9018-4ade-87d2-98af14eed1f0 tempest-CinderUnicodeTest-736744972 None] Lock "cinder-3b7431a7-2440-4dc5-90f9-67b5b6789366-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:11 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b 1073741824" returned: 0 in 0.581s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:11 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b Apr 16 22:24:11 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:11 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b" returned: 0 in 0.620s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.941s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535506351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3155ac1f-ff9c-45b6-b09b-e3c7b786b10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:10Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Creating volume 3155ac1f-ff9c-45b6-b09b-e3c7b786b10f {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:11 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a4b5ac-1e06-4336-b735-3cef00e03557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75c9d80-1863-4cbf-bc19-71407053392b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:11 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f 1073741824 Apr 16 22:24:11 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db4ff9a-58af-48b8-b611-343d88f79aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:11 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume volume-b75c9d80-1863-4cbf-bc19-71407053392b (b75c9d80-1863-4cbf-bc19-71407053392b): created successfully Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db4ff9a-58af-48b8-b611-343d88f79aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (1aec549f-8cff-409f-a383-7d24bbf8e8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:12 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-910c8a56-8304-49da-bd73-da0f636354b3 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created volume successfully. Apr 16 22:24:12 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f 1073741824" returned: 0 in 0.512s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:12 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f Apr 16 22:24:12 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:13 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f" returned: 0 in 0.561s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.774s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586544189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5360fa8-df81-498f-968b-7684f75d3b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:10Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Creating volume d5360fa8-df81-498f-968b-7684f75d3b3b {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:13 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918961c9-3391-43b2-a6ee-3d60bfbbe337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309906f1-0df2-44a8-bfcc-3dcbd377a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:13 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b 1073741824 Apr 16 22:24:13 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:13 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f (3155ac1f-ff9c-45b6-b09b-e3c7b786b10f): created successfully Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309906f1-0df2-44a8-bfcc-3dcbd377a37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (5f16c385-756a-4058-b4fb-ef04b33dfea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:13 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2c716008-abbe-453f-8540-2b75b2335626 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created volume successfully. Apr 16 22:24:13 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b 1073741824" returned: 0 in 0.745s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:13 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b Apr 16 22:24:13 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:14 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b" returned: 0 in 0.504s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.747s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-823664849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792e7934-4e64-4621-b34e-cc512f5a8528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3416d6f55d4fc2a9b4cf22f2ba6b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:10Z,use_quota=True,user_id='de8a56d0cf6a4706b3e5999ce5db0fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Creating volume 792e7934-4e64-4621-b34e-cc512f5a8528 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:14 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8aaa98-f960-4162-b39b-a08d7cc25798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5360fa8-df81-498f-968b-7684f75d3b3b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:14 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 1073741824 Apr 16 22:24:14 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d70202-0f7f-4b67-bef5-051d461fab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:14 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume volume-d5360fa8-df81-498f-968b-7684f75d3b3b (d5360fa8-df81-498f-968b-7684f75d3b3b): created successfully Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d70202-0f7f-4b67-bef5-051d461fab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (923a9a9d-ffe2-4928-9087-0dc26aa70469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:14 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-864eb336-c328-473f-8466-04af7a350120 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created volume successfully. Apr 16 22:24:14 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 1073741824" returned: 0 in 0.513s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:14 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 Apr 16 22:24:14 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:15 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528" returned: 0 in 0.429s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d611bd-1467-47fe-a240-aed6a26506e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792e7934-4e64-4621-b34e-cc512f5a8528', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaed1e6-f456-4ac0-a1f6-b553d3e82f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:15 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Volume volume-792e7934-4e64-4621-b34e-cc512f5a8528 (792e7934-4e64-4621-b34e-cc512f5a8528): created successfully Apr 16 22:24:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaed1e6-f456-4ac0-a1f6-b553d3e82f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Flow 'volume_create_manager' (48fd706c-9008-4b44-9b72-565e0c67e4b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:15 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b8a18a01-34a8-492a-9ccb-82bfded825a2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created volume successfully. Apr 16 22:24:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-792e7934-4e64-4621-b34e-cc512f5a8528-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-792e7934-4e64-4621-b34e-cc512f5a8528-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-quobyte-792e7934-4e64-4621-b34e-cc512f5a8528" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-792e7934-4e64-4621-b34e-cc512f5a8528" acquired by "delete_volume" :: waited 0.007s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f3182-62dd-4588-935a-7323450b6e09]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:16 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 Apr 16 22:24:16 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:16 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528" returned: 0 in 0.521s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:16 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528 Apr 16 22:24:16 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:17 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-792e7934-4e64-4621-b34e-cc512f5a8528" returned: 0 in 0.417s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-792e7934-4e64-4621-b34e-cc512f5a8528" released by "delete_volume" :: held 0.965s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created reservations ['64789a39-0379-4c63-808e-06b79214e8c4', '96a1ba5b-b90f-4b00-ad00-6cf9acaf22d4', 'aad106e5-82cd-485e-bb00-f125206b2c38', '128f757f-66fd-41c3-84a0-199ef508904b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:17 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:17 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-d5360fa8-df81-498f-968b-7684f75d3b3b-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-d5360fa8-df81-498f-968b-7684f75d3b3b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-quobyte-d5360fa8-df81-498f-968b-7684f75d3b3b" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-d5360fa8-df81-498f-968b-7684f75d3b3b" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f3a7d6-5098-48b3-8f8c-cfbb4dd0dbca]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:17 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b Apr 16 22:24:17 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:17 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.426s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:17 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Deleted volume successfully. Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-ad0cbb43-8d2a-4b79-9837-b0d310f35be2 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-792e7934-4e64-4621-b34e-cc512f5a8528-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:17 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b" returned: 0 in 0.521s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:17 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b Apr 16 22:24:17 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:18 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d5360fa8-df81-498f-968b-7684f75d3b3b" returned: 0 in 0.421s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-d5360fa8-df81-498f-968b-7684f75d3b3b" released by "delete_volume" :: held 0.963s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created reservations ['85af8bbc-1559-4534-864c-07e119383b2a', 'cfc3b03a-fba4-4b55-98ba-bdceab5a10dd', 'e06e9df7-b119-4a25-a7ee-00a07e6e298b', '97037b42-6da4-45f9-b5d6-1f20d4951b58'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:18 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:18 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-quobyte-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7af33a-fe42-43ab-9f5b-63438522155c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:18 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f Apr 16 22:24:18 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:18 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.479s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:18 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Deleted volume successfully. Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2d4f80ef-2003-4839-9aee-19e748aa41c4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-d5360fa8-df81-498f-968b-7684f75d3b3b-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:18 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f" returned: 0 in 0.530s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:18 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f Apr 16 22:24:18 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:19 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f" returned: 0 in 0.455s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f" released by "delete_volume" :: held 1.010s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created reservations ['2f753d5c-ce77-4a3a-a00e-94252d81a0e7', '69dc4f09-5573-4cec-a8c0-06d8f00daf98', 'c7c7b2ef-5e30-4b1a-b3ac-c76c81b41a79', '7c7fe215-1dc2-47d5-a451-382a82232e96'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:19 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:19 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:19 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.474s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:20 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Deleted volume successfully. Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-b892b626-cf02-4179-a137-b8d9c9bcb4a4 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-3155ac1f-ff9c-45b6-b09b-e3c7b786b10f-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-b75c9d80-1863-4cbf-bc19-71407053392b-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-b75c9d80-1863-4cbf-bc19-71407053392b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-quobyte-b75c9d80-1863-4cbf-bc19-71407053392b" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-b75c9d80-1863-4cbf-bc19-71407053392b" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[058208ce-6b71-48c5-bad8-3ce2ebeaf77d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:20 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b Apr 16 22:24:20 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:21 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b" returned: 0 in 0.464s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:21 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b Apr 16 22:24:21 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:21 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-b75c9d80-1863-4cbf-bc19-71407053392b" returned: 0 in 0.426s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-b75c9d80-1863-4cbf-bc19-71407053392b" released by "delete_volume" :: held 0.912s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created reservations ['b947cc3f-7445-4b0f-bef6-9bb77f54bf27', '8fdb7afb-c53a-4bce-bfd3-717371adb492', '3a47089f-9888-42ba-b367-38ed54871634', 'aacc043d-11d3-42cb-9a2f-0cb959608f4b'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:21 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:21 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:22 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.435s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:22 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Deleted volume successfully. Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-98729589-4a2e-40e3-a1a4-ba16a6334564 tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-b75c9d80-1863-4cbf-bc19-71407053392b-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-55ae4662-e7e8-4644-b5b0-1d54800803a0-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-55ae4662-e7e8-4644-b5b0-1d54800803a0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-quobyte-55ae4662-e7e8-4644-b5b0-1d54800803a0" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-55ae4662-e7e8-4644-b5b0-1d54800803a0" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[67900e73-5760-4aa6-b466-e3adb7909ec7]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:22 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 Apr 16 22:24:22 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:23 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0" returned: 0 in 0.526s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:23 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0 Apr 16 22:24:23 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:23 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-55ae4662-e7e8-4644-b5b0-1d54800803a0" returned: 0 in 0.471s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-55ae4662-e7e8-4644-b5b0-1d54800803a0" released by "delete_volume" :: held 1.019s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created reservations ['cccd7865-29ad-4b97-92d9-d059297b5b11', '2f9713d7-84b1-456a-ac99-a3fcefce3c9e', '366e4bd1-fdf1-45de-8aca-3324c8b6c1a2', '6c89f772-3c93-42c7-abb6-f87ddd655dec'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:23 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:23 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:24 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.437s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:24 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Deleted volume successfully. Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e99a43f9-7805-47a4-84ba-6a637485b59c tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-55ae4662-e7e8-4644-b5b0-1d54800803a0-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:24 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:24 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:24 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.444s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "cinder-quobyte-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4d35a9-4fb9-407d-a9cf-2b80edfe0851]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:25 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f Apr 16 22:24:25 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:25 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f" returned: 0 in 0.516s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:25 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f Apr 16 22:24:25 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:25 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f" returned: 0 in 0.456s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-quobyte-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f" released by "delete_volume" :: held 1.000s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:25 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Created reservations ['36e4150d-107e-4b81-833d-09e7d6439225', 'a7acdc6a-801a-49e4-8e22-40567366d81e', 'c98345b3-0f54-41b6-b490-45c94f26d8e6', '2b11f851-70f4-45a2-9821-64a9694bd075'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:26 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:26 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:26 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.434s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:26 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Deleted volume successfully. Apr 16 22:24:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e930ecd0-3faf-4e16-8981-6953da7eb91a tempest-CreateVolumesFromSourceVolumeTest-629186793 None] Lock "cinder-a63f08d3-1ddc-4fb4-b288-7f4092fa2e8f-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=87,cinder:UPDATE=130,cinder:INSERT=29,cinder:DELETE=12 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=120,cinder:INSERT=48,cinder:UPDATE=174,cinder:DELETE=13 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (6cebb991-c58d-4c7f-bd59-aedf0fe3fd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580197e5-f018-440d-bb09-b84a8e0c6d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580197e5-f018-440d-bb09-b84a8e0c6d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290255548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1fa6c1-3350-4be3-aee9-c8c84b23da9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9eb16c-0430-4111-b76c-60e35fa81497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9eb16c-0430-4111-b76c-60e35fa81497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819d1421-544d-4762-a82e-4c37d0d4c37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819d1421-544d-4762-a82e-4c37d0d4c37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1fa6c1-3350-4be3-aee9-c8c84b23da9d', 'volume_name': 'volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6d2fdc-7f93-40cd-a467-f3d31364bc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6d2fdc-7f93-40cd-a467-f3d31364bc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fceb96f-9ded-4392-a11c-61c759ac93f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Volume 6e1fa6c1-3350-4be3-aee9-c8c84b23da9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d', 'volume_size': 1} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290255548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1fa6c1-3350-4be3-aee9-c8c84b23da9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Creating volume 6e1fa6c1-3350-4be3-aee9-c8c84b23da9d {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:35 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:35 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d 1073741824 Apr 16 22:24:35 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (1d6c1a36-4ff3-4dfb-95e8-81c33f1e5b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712731f6-1c46-4ff6-aca8-919db90ef132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712731f6-1c46-4ff6-aca8-919db90ef132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1704454580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff8c65b-039f-493b-9326-0eadc39ff5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4107d98b-61b9-4266-9a0e-dc6d7b193de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4107d98b-61b9-4266-9a0e-dc6d7b193de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee863e0-fc07-4b44-9132-aa02bb17bd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee863e0-fc07-4b44-9132-aa02bb17bd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff8c65b-039f-493b-9326-0eadc39ff5f2', 'volume_name': 'volume-eff8c65b-039f-493b-9326-0eadc39ff5f2', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e0b1b1-ba82-4dbb-8f15-2d55401c99d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e0b1b1-ba82-4dbb-8f15-2d55401c99d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc312600-2f93-4ba8-8b6d-6fe2ade72deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume eff8c65b-039f-493b-9326-0eadc39ff5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff8c65b-039f-493b-9326-0eadc39ff5f2', 'volume_size': 1} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (ceea8827-e488-4963-ba94-728ab918b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626de92f-76cb-4ff8-b695-4e80f49e69ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626de92f-76cb-4ff8-b695-4e80f49e69ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481685582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ec012a-2e5b-49c6-a9fe-ac17608f3841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c578ef8-d606-451c-b40d-ff367df08c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c578ef8-d606-451c-b40d-ff367df08c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab9ecd3-1142-43cc-aa85-c18b2cd4c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab9ecd3-1142-43cc-aa85-c18b2cd4c5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ec012a-2e5b-49c6-a9fe-ac17608f3841', 'volume_name': 'volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afb3f18-cb98-45e0-a65e-ddf8bcbe4291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afb3f18-cb98-45e0-a65e-ddf8bcbe4291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f57f0ae-46ec-45f3-8598-4217deac4690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Volume 94ec012a-2e5b-49c6-a9fe-ac17608f3841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841', 'volume_size': 1} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Flow 'volume_create_manager' (d2b7d93b-6d6d-445b-a435-71478954334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d80f30-b5b0-46d1-a8ad-f1b8b970fd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d80f30-b5b0-46d1-a8ad-f1b8b970fd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-813194559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b903df85e40f408d993c3c03b20eb6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='cf4bc8d2d57f4644b82884a9a0385668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3bddb5-e889-4692-9220-6fde55e55d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3bddb5-e889-4692-9220-6fde55e55d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9ea3ad-67c2-4c68-93e1-4ced1556761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9ea3ad-67c2-4c68-93e1-4ced1556761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e5f07c-70d5-44b8-99b2-f50e35b4e2c6', 'volume_name': 'volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca754a8-319b-451d-8fd6-d2b8d34b2069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca754a8-319b-451d-8fd6-d2b8d34b2069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0267b71-7758-4494-a0e2-e59c82caff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Volume d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6', 'volume_size': 1} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (9a21268f-19c1-45b4-862b-e3c2a0d62d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ebbf59-6a1b-487f-b11f-d92a890eaaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ebbf59-6a1b-487f-b11f-d92a890eaaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-468993368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04d554f-1d32-47a2-bf20-5fe0c271ac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04d554f-1d32-47a2-bf20-5fe0c271ac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ef72d-f5fd-4acd-bcf0-479990e14b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ef72d-f5fd-4acd-bcf0-479990e14b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c', 'volume_name': 'volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82fb1c1-5188-4cbb-9e2f-b56e7fc11960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82fb1c1-5188-4cbb-9e2f-b56e7fc11960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07dbeed-c3eb-4caf-8312-46f40d62c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Volume ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c', 'volume_size': 1} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (739f55ec-bbe3-4676-b3f4-e37622ede7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adb4140-cd1e-461b-8006-21a495120f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adb4140-cd1e-461b-8006-21a495120f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962106075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542dbe56-b13f-4b1f-8c01-589cf0c4f851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:36Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23eb97ae-2fe3-457e-8a37-fd27170e6645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23eb97ae-2fe3-457e-8a37-fd27170e6645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650c45de-f080-46a8-81e7-d26b1a5f6844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650c45de-f080-46a8-81e7-d26b1a5f6844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542dbe56-b13f-4b1f-8c01-589cf0c4f851', 'volume_name': 'volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a830969-5ff2-4d71-9df2-5752df6948e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a830969-5ff2-4d71-9df2-5752df6948e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8028525-7d23-4559-af3f-9c3305397d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Volume 542dbe56-b13f-4b1f-8c01-589cf0c4f851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851', 'volume_size': 1} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:35 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (283d3fba-1a6b-4a1f-a345-afe4547ed5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc63810e-dcbb-493e-9187-5e33b8a2ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc63810e-dcbb-493e-9187-5e33b8a2ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-86376689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:36Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c888152-276f-45bc-a028-a32245e87749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c888152-276f-45bc-a028-a32245e87749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404ace62-ee96-4f7e-b558-35633a7638dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404ace62-ee96-4f7e-b558-35633a7638dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf', 'volume_name': 'volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c17442-8437-4d30-88b6-7a154318cfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c17442-8437-4d30-88b6-7a154318cfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d66f051-c42d-4e4c-bbb0-0d08c3a27763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:36 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Volume 6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf', 'volume_size': 1} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:36 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d 1073741824" returned: 0 in 1.091s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:36 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d Apr 16 22:24:36 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:36 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d" returned: 0 in 0.486s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.401s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1704454580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff8c65b-039f-493b-9326-0eadc39ff5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Creating volume eff8c65b-039f-493b-9326-0eadc39ff5f2 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:36 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fceb96f-9ded-4392-a11c-61c759ac93f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5d14d7-8d76-457b-b97b-f71cdbc06bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:36 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 1073741824 Apr 16 22:24:36 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:36 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Volume volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d (6e1fa6c1-3350-4be3-aee9-c8c84b23da9d): created successfully Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5d14d7-8d76-457b-b97b-f71cdbc06bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:36 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (6cebb991-c58d-4c7f-bd59-aedf0fe3fd9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:36 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4d045788-319c-47b2-a79f-c779d8e61714 tempest-CreateVolumesFromImageTest-1664984033 None] Created volume successfully. Apr 16 22:24:37 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 1073741824" returned: 0 in 0.662s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:37 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 Apr 16 22:24:37 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:37 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2" returned: 0 in 0.488s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.491s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481685582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ec012a-2e5b-49c6-a9fe-ac17608f3841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Creating volume 94ec012a-2e5b-49c6-a9fe-ac17608f3841 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:37 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc312600-2f93-4ba8-8b6d-6fe2ade72deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff8c65b-039f-493b-9326-0eadc39ff5f2', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a95da5-f7c2-4710-956e-61db1ce35e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:37 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 1073741824 Apr 16 22:24:37 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:37 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 (eff8c65b-039f-493b-9326-0eadc39ff5f2): created successfully Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a95da5-f7c2-4710-956e-61db1ce35e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:37 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (1d6c1a36-4ff3-4dfb-95e8-81c33f1e5b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9b06efce-1058-45ba-8255-d2ec8bf8d325 tempest-CreateVolumesFromSnapshotTest-666871915 None] Created volume successfully. Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:38 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 1073741824" returned: 0 in 0.614s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:38 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 Apr 16 22:24:38 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:38 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841" returned: 0 in 0.474s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.535s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-813194559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b903df85e40f408d993c3c03b20eb6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='cf4bc8d2d57f4644b82884a9a0385668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Creating volume d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:38 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f57f0ae-46ec-45f3-8598-4217deac4690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cf9a45-209a-4c36-9b8b-05a7bc3cfcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:38 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 1073741824 Apr 16 22:24:38 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:38 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Volume volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 (94ec012a-2e5b-49c6-a9fe-ac17608f3841): created successfully Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cf9a45-209a-4c36-9b8b-05a7bc3cfcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:38 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (ceea8827-e488-4963-ba94-728ab918b79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:38 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4434d902-94f4-4f65-808a-a830e41dee6a tempest-CreateVolumesFromImageTest-1664984033 None] Created volume successfully. Apr 16 22:24:39 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 1073741824" returned: 0 in 0.564s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:39 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 Apr 16 22:24:39 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:39 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" returned: 0 in 0.455s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.469s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-468993368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:35Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Creating volume ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:39 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:40 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0267b71-7758-4494-a0e2-e59c82caff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:40 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c 1073741824 Apr 16 22:24:40 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99ecd6c-108c-4d8c-9392-30406bfa7c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:40 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Volume volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 (d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6): created successfully Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99ecd6c-108c-4d8c-9392-30406bfa7c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Flow 'volume_create_manager' (d2b7d93b-6d6d-445b-a435-71478954334d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:40 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-cad844ab-9cb3-4318-8ed1-ec51efcf24b4 tempest-VolumeDependencyTests-580761201 None] Created volume successfully. Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:40 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c 1073741824" returned: 0 in 0.679s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:40 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:40 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c Apr 16 22:24:40 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:41 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c" returned: 0 in 0.519s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.456s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962106075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542dbe56-b13f-4b1f-8c01-589cf0c4f851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:36Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Creating volume 542dbe56-b13f-4b1f-8c01-589cf0c4f851 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:41 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07dbeed-c3eb-4caf-8312-46f40d62c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1f77cc-6e76-4306-ae99-515e4e23a0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:41 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Volume volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c (ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c): created successfully Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1f77cc-6e76-4306-ae99-515e4e23a0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:41 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 1073741824 Apr 16 22:24:41 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (9a21268f-19c1-45b4-862b-e3c2a0d62d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:41 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6afb08e2-068c-4f4b-b3f9-2f8bbfc8cd6c tempest-CreateVolumesFromImageTest-1664984033 None] Created volume successfully. Apr 16 22:24:41 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 1073741824" returned: 0 in 0.614s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:41 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 Apr 16 22:24:41 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:42 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851" returned: 0 in 0.493s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.320s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-86376689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77aee1617144d5b633d9b55060c354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:36Z,use_quota=True,user_id='a5ced82e28cd476d82082dfae3bb73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Creating volume 6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:42 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8028525-7d23-4559-af3f-9c3305397d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edd77d4-d786-42ed-b044-be03b6d2fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:42 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Volume volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 (542dbe56-b13f-4b1f-8c01-589cf0c4f851): created successfully Apr 16 22:24:42 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf 1073741824 Apr 16 22:24:42 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edd77d4-d786-42ed-b044-be03b6d2fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:42 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (739f55ec-bbe3-4676-b3f4-e37622ede7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:42 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5d43559b-386b-40f2-97b3-f056d5441448 tempest-CreateVolumesFromImageTest-1664984033 None] Created volume successfully. Apr 16 22:24:43 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf 1073741824" returned: 0 in 0.673s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:43 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf Apr 16 22:24:43 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:43 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf" returned: 0 in 0.496s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.211s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Creating offline snapshot eeba7f06-0741-4764-823e-305390ff1784 of volume eff8c65b-039f-493b-9326-0eadc39ff5f2 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d66f051-c42d-4e4c-bbb0-0d08c3a27763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1823b6e7-2542-42f3-b800-f7c5f019fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b115d691-ce23-4211-9c75-f16eaa49ce27]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:43 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Volume volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf (6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf): created successfully Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1823b6e7-2542-42f3-b800-f7c5f019fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:43 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Flow 'volume_create_manager' (283d3fba-1a6b-4a1f-a345-afe4547ed5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1d71ad44-0870-44ca-b863-30046eeb9ad4 tempest-CreateVolumesFromImageTest-1664984033 None] Created volume successfully. Apr 16 22:24:43 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 Apr 16 22:24:43 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:44 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2" returned: 0 in 0.605s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:44 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 1G Apr 16 22:24:44 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-quobyte-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf" acquired by "delete_volume" :: waited 0.031s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[957ce41a-8de8-43ff-a524-b62c90be16c8]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:44 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf Apr 16 22:24:44 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:44 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 1G" returned: 0 in 0.683s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:44 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 Apr 16 22:24:44 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:45 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf" returned: 0 in 0.580s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:45 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf Apr 16 22:24:45 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:45 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784" returned: 0 in 0.492s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:45 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 is being set with open permissions: ugo+rw Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:45 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 Apr 16 22:24:45 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:45 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf" returned: 0 in 0.448s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf" released by "delete_volume" :: held 1.055s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Created reservations ['55d976e2-7055-46b1-be06-75bba7da575e', '01321058-bcdb-4ed0-a0d7-d1917f759b33', '5c9e8b2f-548b-4e4c-a8d7-a15d140dc4ed', '8331522b-e8bf-4afd-bf51-2d49a92170ac'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:45 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784" returned: 0 in 0.470s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:45 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.info Apr 16 22:24:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:45 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:45 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:45 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:46 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.info" returned: 0 in 0.508s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:46 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.info is being set with open permissions: ugo+rw Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:46 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.505s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:46 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.info Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:46 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:46 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Deleted volume successfully. Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d4326468-fa1c-4fe3-866f-ccf3ca0eb3d7 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-6a5d8c70-0f3e-4433-a5ca-a70ef79fb9cf-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-542dbe56-b13f-4b1f-8c01-589cf0c4f851-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-542dbe56-b13f-4b1f-8c01-589cf0c4f851-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-quobyte-542dbe56-b13f-4b1f-8c01-589cf0c4f851" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-542dbe56-b13f-4b1f-8c01-589cf0c4f851" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:46 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.info" returned: 0 in 0.537s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.429s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4512f98-5bf0-4417-ab86-24e3a7fc0290]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.467s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Creating offline snapshot 7be67bb6-ddba-4884-b25b-a515474e8a13 of volume d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:24:47 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a95802be-289b-44fd-b91a-fd92f29707b9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Create snapshot completed successfully Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[746fb9da-9f14-43a2-b263-c829d66e794e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:47 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 Apr 16 22:24:47 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:47 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 Apr 16 22:24:47 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:47 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851" returned: 0 in 0.527s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:47 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851 Apr 16 22:24:47 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:47 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" returned: 0 in 0.562s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:47 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:47 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 1G Apr 16 22:24:47 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (1c235ed7-19ab-4cfc-bfa0-f25d313c8280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5cfea4-1c19-4509-a7e2-145368f12a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5cfea4-1c19-4509-a7e2-145368f12a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-666710546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7bd3d6-a613-415b-8f39-081e31634cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:48Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f82f26d-d0ff-40a8-a286-b8cdb384d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f82f26d-d0ff-40a8-a286-b8cdb384d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26da12f-dca8-477f-a74f-7cd3137fea13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26da12f-dca8-477f-a74f-7cd3137fea13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7bd3d6-a613-415b-8f39-081e31634cf1', 'volume_name': 'volume-7f7bd3d6-a613-415b-8f39-081e31634cf1', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c8eb45-7218-41c0-99c6-0671d1bd5f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c8eb45-7218-41c0-99c6-0671d1bd5f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a4695d-5d5b-4fb2-9665-0b8633418834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume 7f7bd3d6-a613-415b-8f39-081e31634cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7bd3d6-a613-415b-8f39-081e31634cf1', 'volume_size': 1} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:48 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-542dbe56-b13f-4b1f-8c01-589cf0c4f851" returned: 0 in 0.792s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-542dbe56-b13f-4b1f-8c01-589cf0c4f851" released by "delete_volume" :: held 1.388s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (17b8894b-5b82-4d7e-add4-93d000a137f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2055977b-5508-4f97-8518-9b3a20818aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2055977b-5508-4f97-8518-9b3a20818aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675888276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e823e7cc-5410-4e7a-8948-cd67e52238fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:48Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d249c7b-2361-4335-a9c3-b1bf5a17679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d249c7b-2361-4335-a9c3-b1bf5a17679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c69e83c-27c4-4b9c-9148-8dc19b060879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c69e83c-27c4-4b9c-9148-8dc19b060879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e823e7cc-5410-4e7a-8948-cd67e52238fc', 'volume_name': 'volume-e823e7cc-5410-4e7a-8948-cd67e52238fc', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981b24cf-a16a-42a6-9ec6-c07be80f165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981b24cf-a16a-42a6-9ec6-c07be80f165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae0dc7e-0d14-4e82-b6b9-4049aa1d8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume e823e7cc-5410-4e7a-8948-cd67e52238fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e823e7cc-5410-4e7a-8948-cd67e52238fc', 'volume_size': 1} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Created reservations ['22aea2a7-6902-4c6f-ba9f-9dffb3740898', '9f5ccb87-76d8-4abf-96a3-7c05d796ec9d', 'bb5cca9d-99f2-4692-8bfe-1137003fd071', '56eae050-9ebe-4be0-bfe9-a190360e4fd8'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 1G" returned: 0 in 0.833s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:48 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 Apr 16 22:24:48 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:48 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:48 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (28543812-059c-4057-8630-60d9e9a0e9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfa4ed3-71e8-41d7-a6d5-68894e2d3885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfa4ed3-71e8-41d7-a6d5-68894e2d3885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699070408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b95fb19-8260-4120-9439-22fec494fec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:49Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcbd8a8-154c-4c6b-aafb-5065457084f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcbd8a8-154c-4c6b-aafb-5065457084f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd35ddc-ea9c-4818-8b64-3f2cdf02687f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd35ddc-ea9c-4818-8b64-3f2cdf02687f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b95fb19-8260-4120-9439-22fec494fec7', 'volume_name': 'volume-6b95fb19-8260-4120-9439-22fec494fec7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2978ac0b-f962-4642-96c8-5ff12ad2b1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2978ac0b-f962-4642-96c8-5ff12ad2b1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b8d89b-cb78-4db6-b562-a7743599a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:48 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume 6b95fb19-8260-4120-9439-22fec494fec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b95fb19-8260-4120-9439-22fec494fec7', 'volume_size': 1} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:48 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (950e8011-ae3b-4633-b1ce-50c0b472633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1375296-cdf6-4586-9ac3-668f44472384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1375296-cdf6-4586-9ac3-668f44472384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-897170151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2e2ab8-9499-4e79-b1dd-2a53181f2376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:49Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222da344-23c3-4532-bd8f-9c2bbb4bac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222da344-23c3-4532-bd8f-9c2bbb4bac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e352fb0b-8133-4176-9ea4-f670c73b277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e352fb0b-8133-4176-9ea4-f670c73b277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2e2ab8-9499-4e79-b1dd-2a53181f2376', 'volume_name': 'volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e47b9a7-0a78-4ed9-aec3-decb2002ad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e47b9a7-0a78-4ed9-aec3-decb2002ad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc4c39e-ab38-482d-a6c9-fccc5a3407b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume 1d2e2ab8-9499-4e79-b1dd-2a53181f2376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376', 'volume_size': 1} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:49 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13" returned: 0 in 0.723s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:49 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 is being set with open permissions: ugo+rw Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:49 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 Apr 16 22:24:49 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (05063bcc-f6de-4397-9702-ba2812164d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3d394d-c58b-435d-95fd-6eb8d2bd14b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3d394d-c58b-435d-95fd-6eb8d2bd14b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1779345321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:49Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07b667a-af75-4218-9aef-7db20b27fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07b667a-af75-4218-9aef-7db20b27fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad55251c-dded-48e3-b5ee-566a8f6dc282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad55251c-dded-48e3-b5ee-566a8f6dc282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b', 'volume_name': 'volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c01645-e536-467e-9bf6-83b16f06bc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c01645-e536-467e-9bf6-83b16f06bc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7720aa-9cd2-4cb5-8d5f-6959d21f06ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:49 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume 4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b', 'volume_size': 1} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-quobyte-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c26bcd-2b3b-4c67-a75b-9693b4d4a6b6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:49 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c Apr 16 22:24:49 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:49 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.927s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:49 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Deleted volume successfully. Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-6c120693-9b3a-432d-bd59-23d3ce8521d9 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-542dbe56-b13f-4b1f-8c01-589cf0c4f851-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:49 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13" returned: 0 in 0.552s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:49 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:49 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.info Apr 16 22:24:49 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:50 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c" returned: 0 in 0.727s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:50 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c Apr 16 22:24:50 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:50 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.info" returned: 0 in 0.503s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:50 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.info is being set with open permissions: ugo+rw Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:50 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.info Apr 16 22:24:50 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:50 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c" returned: 0 in 0.628s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c" released by "delete_volume" :: held 1.383s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Created reservations ['c32961db-313a-4021-9d22-593040941d6b', '39784c40-1237-417a-a9d7-d97d851cdea0', '06b059f2-3fcb-4c7f-a490-22f74df77783', 'cb8006e9-9c12-4bbf-87f0-dcaf27865704'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:50 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.info" returned: 0 in 0.554s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.848s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.629s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-666710546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7bd3d6-a613-415b-8f39-081e31634cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:48Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Creating volume 7f7bd3d6-a613-415b-8f39-081e31634cf1 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:50 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:50 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 1073741824 Apr 16 22:24:50 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:50 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f53b4880-f9b2-470f-bd5a-5831550e4a3d tempest-VolumeDependencyTests-580761201 None] Create snapshot completed successfully Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:50 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:50 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:50 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-94ec012a-2e5b-49c6-a9fe-ac17608f3841-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-94ec012a-2e5b-49c6-a9fe-ac17608f3841-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-quobyte-94ec012a-2e5b-49c6-a9fe-ac17608f3841" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:51 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-94ec012a-2e5b-49c6-a9fe-ac17608f3841" acquired by "delete_volume" :: waited 0.026s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 1073741824" returned: 0 in 0.693s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b8fd0f-4ec7-4a9c-8e28-10d57f52abd2]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:51 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.663s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:51 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Deleted volume successfully. Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:51 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 Apr 16 22:24:51 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:51 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bab10eb4-27c1-4d45-9f6a-dfb60b65eaf6 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-ebe7c1e9-9b2b-44cf-8dc3-53de8a784a1c-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:51 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 Apr 16 22:24:51 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:52 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1" returned: 0 in 0.711s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.871s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675888276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e823e7cc-5410-4e7a-8948-cd67e52238fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:48Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Creating volume e823e7cc-5410-4e7a-8948-cd67e52238fc {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:52 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:52 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841" returned: 0 in 0.786s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:52 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc 1073741824 Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a4695d-5d5b-4fb2-9665-0b8633418834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7bd3d6-a613-415b-8f39-081e31634cf1', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:52 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0c7dd8-816e-472f-adfb-ebfacf3c8652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Flow 'volume_create_manager' (767a227a-4d58-4f4a-93c0-9bfa69d01abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5396de1-3447-42fd-8bbb-d8e6c6a116e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:52 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841 Apr 16 22:24:52 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:52 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 (7f7bd3d6-a613-415b-8f39-081e31634cf1): created successfully Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0c7dd8-816e-472f-adfb-ebfacf3c8652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (1c235ed7-19ab-4cfc-bfa0-f25d313c8280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5396de1-3447-42fd-8bbb-d8e6c6a116e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1517411866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb86851-39cf-4cc5-be38-1cb143f815e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b903df85e40f408d993c3c03b20eb6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7be67bb6-ddba-4884-b25b-a515474e8a13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:52Z,use_quota=True,user_id='cf4bc8d2d57f4644b82884a9a0385668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4778424f-b6c9-4f23-8654-837baa35388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4778424f-b6c9-4f23-8654-837baa35388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d62e15-bb4a-4459-bd1f-06cd820d623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d62e15-bb4a-4459-bd1f-06cd820d623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6fb86851-39cf-4cc5-be38-1cb143f815e9', 'volume_name': 'volume-6fb86851-39cf-4cc5-be38-1cb143f815e9', 'volume_size': 1, 'snapshot_id': '7be67bb6-ddba-4884-b25b-a515474e8a13'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b428ba-aa0f-4cba-a852-a4ad8b6c6f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b428ba-aa0f-4cba-a852-a4ad8b6c6f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6101ccb1-3361-422e-899b-9d66f840c2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:52 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Volume 6fb86851-39cf-4cc5-be38-1cb143f815e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6fb86851-39cf-4cc5-be38-1cb143f815e9', 'volume_size': 1, 'snapshot_id': '7be67bb6-ddba-4884-b25b-a515474e8a13'} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:52 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5f8cfcc6-4647-4d48-a618-acc7ede4181a tempest-CreateVolumesFromSnapshotTest-666871915 None] Created volume successfully. Apr 16 22:24:52 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-94ec012a-2e5b-49c6-a9fe-ac17608f3841" returned: 0 in 0.523s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-94ec012a-2e5b-49c6-a9fe-ac17608f3841" released by "delete_volume" :: held 1.347s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Created reservations ['62e4200e-bd05-4384-ac95-6384970e2232', 'd7746353-4b8d-4ed8-9bf6-bb1a645373a6', 'bca6937e-022c-4afd-bff7-cca4623ac94a', 'f69189f7-6b02-4f99-8e00-71f25188b259'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:52 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc 1073741824" returned: 0 in 0.611s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:52 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:53 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc Apr 16 22:24:53 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:53 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:53 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:53 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.555s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:53 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Deleted volume successfully. Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-2a060f6e-bac3-47ed-9bc7-c03837ae2153 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-94ec012a-2e5b-49c6-a9fe-ac17608f3841-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:53 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc" returned: 0 in 0.655s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.763s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699070408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b95fb19-8260-4120-9439-22fec494fec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:49Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Creating volume 6b95fb19-8260-4120-9439-22fec494fec7 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:53 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:53 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 1073741824 Apr 16 22:24:53 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae0dc7e-0d14-4e82-b6b9-4049aa1d8a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e823e7cc-5410-4e7a-8948-cd67e52238fc', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efbb319-7fa1-4bba-ba12-b61a87c178d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:53 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume volume-e823e7cc-5410-4e7a-8948-cd67e52238fc (e823e7cc-5410-4e7a-8948-cd67e52238fc): created successfully Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efbb319-7fa1-4bba-ba12-b61a87c178d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (17b8894b-5b82-4d7e-add4-93d000a137f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:53 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d3793c07-8007-4af2-a5f9-17e922162a42 tempest-CreateVolumesFromSnapshotTest-666871915 None] Created volume successfully. Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "cinder-quobyte-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d" acquired by "delete_volume" :: waited 0.007s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c371a2e0-dace-4530-8b52-a34ab54bcfd0]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:53 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:53 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d Apr 16 22:24:53 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:54 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 1073741824" returned: 0 in 0.611s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:54 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 Apr 16 22:24:54 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:54 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Flow 'volume_create_manager' (6859511f-2949-4690-82bb-81c5dad79377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdaf09b4-7f17-4686-82f5-8cca9038f22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d" returned: 0 in 0.678s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:54 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d Apr 16 22:24:54 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdaf09b4-7f17-4686-82f5-8cca9038f22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-889319526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443d5ef8-1dc0-4157-b8c5-cc2848330211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46fb6940024448785394e8d364ae9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:54Z,use_quota=True,user_id='88d4bec35d854783942d66fc77d27545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a3af49-8a71-42ec-935d-aa21fdfba515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a3af49-8a71-42ec-935d-aa21fdfba515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6bf39c-ed31-41eb-9ab0-da6237dedfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6bf39c-ed31-41eb-9ab0-da6237dedfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443d5ef8-1dc0-4157-b8c5-cc2848330211', 'volume_name': 'volume-443d5ef8-1dc0-4157-b8c5-cc2848330211', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539a57b4-82bf-4075-99e5-ad1ecc8e2fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539a57b4-82bf-4075-99e5-ad1ecc8e2fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea554af7-974a-42fb-be46-eaf6cea63d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:54 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Volume 443d5ef8-1dc0-4157-b8c5-cc2848330211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443d5ef8-1dc0-4157-b8c5-cc2848330211', 'volume_size': 1} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:54 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7" returned: 0 in 0.499s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.623s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-897170151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2e2ab8-9499-4e79-b1dd-2a53181f2376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:49Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Creating volume 1d2e2ab8-9499-4e79-b1dd-2a53181f2376 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:54 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:54 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 1073741824 Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b8d89b-cb78-4db6-b562-a7743599a39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b95fb19-8260-4120-9439-22fec494fec7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:54 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33df6a17-2b74-4071-bb72-f37b894ae6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:54 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume volume-6b95fb19-8260-4120-9439-22fec494fec7 (6b95fb19-8260-4120-9439-22fec494fec7): created successfully Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33df6a17-2b74-4071-bb72-f37b894ae6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (28543812-059c-4057-8630-60d9e9a0e9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:54 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-92bf173e-77c9-4e5c-957b-34df7b42b459 tempest-CreateVolumesFromSnapshotTest-666871915 None] Created volume successfully. Apr 16 22:24:54 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d" returned: 0 in 0.503s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-quobyte-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d" released by "delete_volume" :: held 1.208s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:54 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Created reservations ['f666fc5f-91b9-4768-8a32-42f19b1db6d0', 'f9aed499-3742-46ba-9e90-0179b3a18e48', '9c84da0c-d2fd-4f7e-96b1-12b3686886fc', 'ac505c0a-ef87-48a5-a0c2-d562dd7eebe2'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:55 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:55 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:55 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 1073741824" returned: 0 in 0.566s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:55 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 Apr 16 22:24:55 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:55 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.523s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:24:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Deleted volume successfully. Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5f39dab3-85af-4cfe-a4d4-36ac6d2fb771 tempest-CreateVolumesFromImageTest-1664984033 None] Lock "cinder-6e1fa6c1-3350-4be3-aee9-c8c84b23da9d-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:55 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376" returned: 0 in 0.450s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.497s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1779345321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea9224f5358485fbc382f8f42fc7b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:49Z,use_quota=True,user_id='0daa225575774a81a522bd5e831596ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Creating volume 4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:55 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc4c39e-ab38-482d-a6c9-fccc5a3407b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:55 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b 1073741824 Apr 16 22:24:55 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19931dc1-c8a9-4c81-a018-a0dcf4fe37e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:55 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 (1d2e2ab8-9499-4e79-b1dd-2a53181f2376): created successfully Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19931dc1-c8a9-4c81-a018-a0dcf4fe37e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:55 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (950e8011-ae3b-4633-b1ce-50c0b472633a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:55 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5dc0bf7c-00b5-4c03-bc8a-a42f4b3579c9 tempest-CreateVolumesFromSnapshotTest-666871915 None] Created volume successfully. Apr 16 22:24:56 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b 1073741824" returned: 0 in 0.652s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:56 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:56 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b Apr 16 22:24:56 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:57 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b" returned: 0 in 0.555s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.621s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-7be67bb6-ddba-4884-b25b-a515474e8a13-6fb86851-39cf-4cc5-be38-1cb143f815e9" by "_create_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7720aa-9cd2-4cb5-8d5f-6959d21f06ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbb8eeb-e12a-4e08-a196-ce73a4e4133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-7be67bb6-ddba-4884-b25b-a515474e8a13-6fb86851-39cf-4cc5-be38-1cb143f815e9" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Creating volume 6fb86851-39cf-4cc5-be38-1cb143f815e9 from snapshot 7be67bb6-ddba-4884-b25b-a515474e8a13 {{(pid=82650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-6fb86851-39cf-4cc5-be38-1cb143f815e9" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:57 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Volume volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b (4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b): created successfully Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbb8eeb-e12a-4e08-a196-ce73a4e4133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Flow 'volume_create_manager' (05063bcc-f6de-4397-9702-ba2812164d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:57 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b930ba9c-6b0d-4ecf-929f-d63a5645726c tempest-CreateVolumesFromSnapshotTest-666871915 None] Created volume successfully. Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-6fb86851-39cf-4cc5-be38-1cb143f815e9" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] snapshot: 7be67bb6-ddba-4884-b25b-a515474e8a13, volume: 6fb86851-39cf-4cc5-be38-1cb143f815e9, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[526fd068-4803-4265-bf8b-b8689a45b622]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:57 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 Apr 16 22:24:57 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:57 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (747f086f-d34f-4bd8-a7ca-868f6a2ed666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c8a269-3587-4d07-9d11-fb578ccf1496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13" returned: 0 in 0.719s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:24:57 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c8a269-3587-4d07-9d11-fb578ccf1496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217413843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:58Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6299ec3-0d9a-48b5-a075-bf568984c2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6299ec3-0d9a-48b5-a075-bf568984c2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02011aaa-d429-4883-b296-456bf02cdcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02011aaa-d429-4883-b296-456bf02cdcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f', 'volume_name': 'volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb8c4d8-cf7d-4216-8d29-5b206d661480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb8c4d8-cf7d-4216-8d29-5b206d661480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209c3ecf-f4ce-4982-9a3e-86e89fb7c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:24:58 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f', 'volume_size': 1} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfae613-e30c-446f-9790-902d37f52be1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-quobyte-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1fa1af-158c-49c6-bf61-7aafb93f5a1c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:58 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 Apr 16 22:24:58 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:58 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b Apr 16 22:24:58 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:58 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" returned: 0 in 0.590s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:58 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 Apr 16 22:24:58 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:58 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b" returned: 0 in 0.557s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:58 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:58 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b Apr 16 22:24:58 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b" returned: 0 in 0.425s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:24:59 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b" released by "delete_volume" :: held 1.006s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Created reservations ['0f64b5c5-1782-470b-bfd3-bb72b1d90c6a', 'e4f45f80-2b33-4f50-972c-c77ebf7eea4e', 'b78375d3-d04c-42c1-aa97-cce6d92498bb', '726e6eeb-2143-42f5-b9d2-29140ec41c74'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:24:59 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:24:59 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:24:59 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-1d2e2ab8-9499-4e79-b1dd-2a53181f2376-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-1d2e2ab8-9499-4e79-b1dd-2a53181f2376-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-quobyte-1d2e2ab8-9499-4e79-b1dd-2a53181f2376" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-1d2e2ab8-9499-4e79-b1dd-2a53181f2376" acquired by "delete_volume" :: waited 0.034s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a5c5b-c835-4ea9-973f-a6a20686a89d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:00 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.559s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:00 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Deleted volume successfully. Apr 16 22:25:00 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 Apr 16 22:25:00 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:00 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-922e6b02-a82d-4fcd-b7d4-7542b71fd54b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-4816913d-cd93-4e8a-b8eb-b2e19cfd1f6b-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:01 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9" returned: 0 in 2.591s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c7f6de-606a-4e02-a2f4-56fc2a951b2a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:01 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 Apr 16 22:25:01 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:01 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376" returned: 0 in 0.864s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:01 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376 Apr 16 22:25:01 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:01 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1d2e2ab8-9499-4e79-b1dd-2a53181f2376" returned: 0 in 0.467s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-1d2e2ab8-9499-4e79-b1dd-2a53181f2376" released by "delete_volume" :: held 1.378s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:01 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" returned: 0 in 0.672s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6, size 1024.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:25:01 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Converted 1024.00 MB image at 395.11 MB/s Apr 16 22:25:01 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 is being set with open permissions: ugo+rw Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Created reservations ['8d200bda-ca6b-42e3-9b7a-674bb9fce9c5', '7b03d21d-ed79-4e0d-acc4-571474ad803c', '18c35476-a3e4-4e1d-a3fa-4d8005336d9b', 'fd4c32c0-0175-4a4b-aee0-e415070eea6e'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:01 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 Apr 16 22:25:01 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:01 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:01 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:01 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:02 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9" returned: 0 in 0.511s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-6fb86851-39cf-4cc5-be38-1cb143f815e9" released by "_copy_volume_from_snapshot" :: held 5.250s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-7be67bb6-ddba-4884-b25b-a515474e8a13-6fb86851-39cf-4cc5-be38-1cb143f815e9" released by "_create_volume_from_snapshot" :: held 5.300s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.329s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.930s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-889319526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443d5ef8-1dc0-4157-b8c5-cc2848330211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46fb6940024448785394e8d364ae9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:54Z,use_quota=True,user_id='88d4bec35d854783942d66fc77d27545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Creating volume 443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:02 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:02 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 1073741824 Apr 16 22:25:02 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6101ccb1-3361-422e-899b-9d66f840c2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb86851-39cf-4cc5-be38-1cb143f815e9', 'volume_size': 1, 'snapshot_id': '7be67bb6-ddba-4884-b25b-a515474e8a13'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c18da0f-2532-4fef-b9ee-ecdea61ff4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:02 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Volume volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 (6fb86851-39cf-4cc5-be38-1cb143f815e9): created successfully Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c18da0f-2532-4fef-b9ee-ecdea61ff4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Flow 'volume_create_manager' (767a227a-4d58-4f4a-93c0-9bfa69d01abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-040e54b9-cffd-4503-8f4d-48d2143ce626 tempest-VolumeDependencyTests-580761201 None] Created volume successfully. Apr 16 22:25:02 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.548s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:02 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Deleted volume successfully. Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9cdd0e60-5b66-4fd4-ab9e-540279fc61ca tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-1d2e2ab8-9499-4e79-b1dd-2a53181f2376-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-6b95fb19-8260-4120-9439-22fec494fec7-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-6b95fb19-8260-4120-9439-22fec494fec7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-quobyte-6b95fb19-8260-4120-9439-22fec494fec7" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-6b95fb19-8260-4120-9439-22fec494fec7" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c98b31-2a51-4267-b223-04f3c76190f1]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:02 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:02 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 Apr 16 22:25:02 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:03 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 1073741824" returned: 0 in 0.629s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:03 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 Apr 16 22:25:03 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-7be67bb6-ddba-4884-b25b-a515474e8a13-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-7be67bb6-ddba-4884-b25b-a515474e8a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-7be67bb6-ddba-4884-b25b-a515474e8a13" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-7be67bb6-ddba-4884-b25b-a515474e8a13" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Deleting offline snapshot 7be67bb6-ddba-4884-b25b-a515474e8a13 of volume d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] snapshot_file for this snap is: volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a4d49d-c7ca-4cbd-a508-6aff5b896f0f]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:03 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7" returned: 0 in 0.606s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:03 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7 Apr 16 22:25:03 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:03 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 Apr 16 22:25:03 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:03 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211" returned: 0 in 0.544s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.617s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217413843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:24:58Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Creating volume d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:03 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea554af7-974a-42fb-be46-eaf6cea63d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443d5ef8-1dc0-4157-b8c5-cc2848330211', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9fa5ef-49ee-4656-85b2-2b797c21d970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:03 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f 1073741824 Apr 16 22:25:03 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:03 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Volume volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 (443d5ef8-1dc0-4157-b8c5-cc2848330211): created successfully Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9fa5ef-49ee-4656-85b2-2b797c21d970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Flow 'volume_create_manager' (6859511f-2949-4690-82bb-81c5dad79377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:03 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3d0e8a93-558a-467e-93fc-017a53862696 tempest-SnapshotDependencyTests-1852150043 None] Created volume successfully. Apr 16 22:25:03 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6b95fb19-8260-4120-9439-22fec494fec7" returned: 0 in 0.492s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-6b95fb19-8260-4120-9439-22fec494fec7" released by "delete_volume" :: held 1.124s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Created reservations ['fedc9f53-2a56-4d5e-be03-9626cbe3138b', '90ba9517-7800-4cc4-b184-d88dfd9463e0', '499ded9a-a5d3-409e-bfe4-b50fed39e2ee', '640a2797-85a9-47ef-a4fe-19b73f75f48f'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:03 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13" returned: 0 in 0.651s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b1a7d7-18da-412d-904e-85b8934e6bd6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:03 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:04 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:04 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:04 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 Apr 16 22:25:04 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:04 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f 1073741824" returned: 0 in 0.736s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:04 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f Apr 16 22:25:04 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:04 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.558s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:04 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Deleted volume successfully. Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-8c4e3673-4459-4efa-b926-664617f34f80 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-6b95fb19-8260-4120-9439-22fec494fec7-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:04 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" returned: 0 in 0.644s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:04 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 Apr 16 22:25:04 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-e823e7cc-5410-4e7a-8948-cd67e52238fc-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-e823e7cc-5410-4e7a-8948-cd67e52238fc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:04 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f" returned: 0 in 0.476s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.581s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Creating offline snapshot 9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa of volume 443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-quobyte-e823e7cc-5410-4e7a-8948-cd67e52238fc" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[943e5dcd-3daa-4af7-93d1-4117fd7385c3]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209c3ecf-f4ce-4982-9a3e-86e89fb7c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d169f0c1-5860-4f70-8857-976587b7ceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:04 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f (d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f): created successfully Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d169f0c1-5860-4f70-8857-976587b7ceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (747f086f-d34f-4bd8-a7ca-868f6a2ed666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:04 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-e823e7cc-5410-4e7a-8948-cd67e52238fc" acquired by "delete_volume" :: waited 0.055s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-b1364fb1-ab79-46a0-af74-e1916cb4f76f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created volume successfully. Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb5bfa6-5011-405e-a624-044aad4237c0]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:05 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 Apr 16 22:25:05 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:05 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc Apr 16 22:25:05 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:05 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13" returned: 0 in 0.495s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:05 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13 Apr 16 22:25:05 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:05 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211" returned: 0 in 0.514s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:05 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa 1G Apr 16 22:25:05 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:05 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6.7be67bb6-ddba-4884-b25b-a515474e8a13" returned: 0 in 0.436s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-7be67bb6-ddba-4884-b25b-a515474e8a13" released by "_delete_snapshot" :: held 2.290s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" released by "delete_snapshot" :: held 2.301s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:05 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc" returned: 0 in 0.611s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Created reservations ['da44dfca-b934-4ad1-9178-92c0174d5937', '0026dce6-86de-4d02-9a07-391fdfdf900f', '4cd61062-996a-4818-adeb-b7c1e9b53171', 'f7932ced-0d55-4e5c-9f4d-a63fa6c28748'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:05 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc Apr 16 22:25:05 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:05 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Delete snapshot completed successfully. Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-9047acaa-fef1-41b1-911a-7c66dea08212 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-7be67bb6-ddba-4884-b25b-a515474e8a13-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (f2a4d48b-2dae-4194-b87d-2bd669859635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aca83d6-30d7-45dc-bcd5-579145a56d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aca83d6-30d7-45dc-bcd5-579145a56d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1799689039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0ec2ce-9cdb-4055-818a-ff842b3999e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:06Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1184fd-1a37-4479-ba39-ee36062f96b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1184fd-1a37-4479-ba39-ee36062f96b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90027e6e-fa15-452a-9c4d-df2d8a558c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90027e6e-fa15-452a-9c4d-df2d8a558c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0ec2ce-9cdb-4055-818a-ff842b3999e3', 'volume_name': 'volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858578b6-30b1-4ee2-8d09-adf564b508e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858578b6-30b1-4ee2-8d09-adf564b508e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dee7c0-fd62-4719-9967-d17dae891c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:05 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume 9c0ec2ce-9cdb-4055-818a-ff842b3999e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3', 'volume_size': 1} Apr 16 22:25:05 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:06 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (6865315e-885a-44d5-864d-1ff820dc24d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00f62e6-0ac4-4d55-bf40-fe4678a7c27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00f62e6-0ac4-4d55-bf40-fe4678a7c27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2145441554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d4fb5d-86f7-42bd-8180-546d93f2b9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:06Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2d7823-b5b8-4ab6-ae00-9c32c6dc2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2d7823-b5b8-4ab6-ae00-9c32c6dc2d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b9f3f9-6381-4136-9e17-4e544f62112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b9f3f9-6381-4136-9e17-4e544f62112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d4fb5d-86f7-42bd-8180-546d93f2b9ea', 'volume_name': 'volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479bcf4b-9126-49e8-b48f-69184ceb5f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479bcf4b-9126-49e8-b48f-69184ceb5f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427e1c39-2f48-45fe-96e4-749f58f7f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume d2d4fb5d-86f7-42bd-8180-546d93f2b9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea', 'volume_size': 1} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa 1G" returned: 0 in 0.718s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-e823e7cc-5410-4e7a-8948-cd67e52238fc" returned: 0 in 0.563s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-e823e7cc-5410-4e7a-8948-cd67e52238fc" released by "delete_volume" :: held 1.204s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:06 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa Apr 16 22:25:06 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Created reservations ['805ee284-3695-4d56-a018-11beb437d200', 'fdfd2a02-ce61-43db-ab0d-6bc8f8df2ab0', '7b306735-8073-4ea9-abd2-e8cc484771e6', '3912e9a4-1670-4ac8-a27c-d11df7115d8a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:06 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:06 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (b2a0d83e-6a2b-461d-8c23-ed77490a91d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2d3389-8570-48e1-88a9-f120ad6aec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2d3389-8570-48e1-88a9-f120ad6aec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453090107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556e1ba9-7c4c-45fb-b48d-7f2966aef9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:06Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ea4347-857c-494d-8f6b-0500e45ab562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ea4347-857c-494d-8f6b-0500e45ab562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4425eb54-600d-4e88-b4c9-c155d24aa2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4425eb54-600d-4e88-b4c9-c155d24aa2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556e1ba9-7c4c-45fb-b48d-7f2966aef9d0', 'volume_name': 'volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e1bb18-24d1-42b4-857d-a76abd402532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e1bb18-24d1-42b4-857d-a76abd402532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36610b44-aed6-4477-94ec-ed6ba5004488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume 556e1ba9-7c4c-45fb-b48d-7f2966aef9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0', 'volume_size': 1} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Lock "cinder-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" acquired by "delete_volume" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3197c720-37dc-4f56-9c42-5585b8991ab6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (52be06d1-3a52-4ab0-b3b6-212ba1fb9f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd2ead2-32aa-463a-b433-13b65f694880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd2ead2-32aa-463a-b433-13b65f694880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999976459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc200aa0-6321-478c-9095-7b4b3c049884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:07Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 Apr 16 22:25:06 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470f638f-25cf-47f6-b218-275eff684de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470f638f-25cf-47f6-b218-275eff684de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2b76e4-f043-4497-886a-ee6baf3b4d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2b76e4-f043-4497-886a-ee6baf3b4d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc200aa0-6321-478c-9095-7b4b3c049884', 'volume_name': 'volume-cc200aa0-6321-478c-9095-7b4b3c049884', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fad9427-de04-44dd-9422-c29aa2dc9805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fad9427-de04-44dd-9422-c29aa2dc9805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e24bc45-9646-40b2-99ad-914c9442d246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume cc200aa0-6321-478c-9095-7b4b3c049884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc200aa0-6321-478c-9095-7b4b3c049884', 'volume_size': 1} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:06 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (ee8df3db-fe2e-4b90-9ee4-85347df7b494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aba5df7-eb15-4927-bd81-71c553a01fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.607s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:06 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Deleted volume successfully. Apr 16 22:25:06 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aba5df7-eb15-4927-bd81-71c553a01fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397469882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc2b751-4c1a-4011-a4a0-2f458aaea580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:07Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ef53f0-041a-4f03-93dd-f96910cfa7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ef53f0-041a-4f03-93dd-f96910cfa7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:06 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be07ef3a-3d54-49b9-9cd3-a4a97e3255b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be07ef3a-3d54-49b9-9cd3-a4a97e3255b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc2b751-4c1a-4011-a4a0-2f458aaea580', 'volume_name': 'volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b4fe8e-5b4c-40c1-bb81-156aaed784f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b4fe8e-5b4c-40c1-bb81-156aaed784f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4465013-a4d4-4484-8b13-0e8b3b997d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:07 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume 7bc2b751-4c1a-4011-a4a0-2f458aaea580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580', 'volume_size': 1} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" returned: 0 in 0.837s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:07 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa is being set with open permissions: ugo+rw Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-5af396a9-bc36-4632-995b-404aacc2be5b tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-e823e7cc-5410-4e7a-8948-cd67e52238fc-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:07 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa Apr 16 22:25:07 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-7f7bd3d6-a613-415b-8f39-081e31634cf1-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-7f7bd3d6-a613-415b-8f39-081e31634cf1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-quobyte-7f7bd3d6-a613-415b-8f39-081e31634cf1" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-7f7bd3d6-a613-415b-8f39-081e31634cf1" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f29bb-897c-4a2a-8b9f-e361c6aebfc6]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:07 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 Apr 16 22:25:07 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:07 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" returned: 0 in 0.716s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:07 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6 Apr 16 22:25:07 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:07 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" returned: 0 in 0.516s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:07 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.info Apr 16 22:25:07 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:07 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1" returned: 0 in 0.576s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:07 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1 Apr 16 22:25:07 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:07 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" returned: 0 in 0.527s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6" released by "delete_volume" :: held 1.295s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Created reservations ['d1e71257-8701-4e42-b2c1-3d682b7f232c', '5d910ea7-5e36-4b98-8871-7ae53b2efe4d', '54561e2b-817c-4e63-b7d2-e3a00a9cfc7a', 'de2462a3-e7de-406c-8552-086c1e779bcf'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:07 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:08 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:08 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:08 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.info" returned: 0 in 0.497s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:08 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.info is being set with open permissions: ugo+rw Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:08 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.info Apr 16 22:25:08 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:08 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7f7bd3d6-a613-415b-8f39-081e31634cf1" returned: 0 in 0.494s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-7f7bd3d6-a613-415b-8f39-081e31634cf1" released by "delete_volume" :: held 1.106s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Created reservations ['9722f6e0-bc3b-4fd7-b00b-4c97f8a5272c', 'ed352cb9-bfdb-4a46-8925-2f8515a308e3', 'cc9d0321-86b0-414b-a4db-0eb369febfab', '434f44af-8e2c-4b51-977d-d1f080194554'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:08 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:08 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:08 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.508s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Deleted volume successfully. Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-bad403f7-2a2b-4600-ade4-99f512bd6abe tempest-VolumeDependencyTests-580761201 None] Lock "cinder-d3e5f07c-70d5-44b8-99b2-f50e35b4e2c6-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:08 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.info" returned: 0 in 0.516s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.673s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.679s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1799689039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0ec2ce-9cdb-4055-818a-ff842b3999e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:06Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Creating volume 9c0ec2ce-9cdb-4055-818a-ff842b3999e3 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:08 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:08 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 1073741824 Apr 16 22:25:08 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-365e998a-e689-4325-af6c-9b6f30002d58 tempest-SnapshotDependencyTests-1852150043 None] Create snapshot completed successfully Apr 16 22:25:08 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.529s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:08 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Deleted volume successfully. Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-519c6b8f-79c8-4357-b458-58c677a0b32a tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-7f7bd3d6-a613-415b-8f39-081e31634cf1-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:08 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Flow 'volume_create_manager' (6a883488-106e-476e-92c2-a062eb90bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbc3fe8-c41d-4808-8800-aa045dd229a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbc3fe8-c41d-4808-8800-aa045dd229a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-197836391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb75b1c-21eb-4a55-8f0a-0937975dcfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b903df85e40f408d993c3c03b20eb6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:09Z,use_quota=True,user_id='cf4bc8d2d57f4644b82884a9a0385668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8763650-16a9-4f26-b9eb-9e391eb7ad14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8763650-16a9-4f26-b9eb-9e391eb7ad14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035e753d-3623-455f-8c09-84044c45aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035e753d-3623-455f-8c09-84044c45aebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb75b1c-21eb-4a55-8f0a-0937975dcfb7', 'volume_name': 'volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dfe820-7c2f-4962-b56c-d161021e5056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dfe820-7c2f-4962-b56c-d161021e5056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40673c4-ba20-4d40-87ff-e2cf495b922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:09 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Volume 6eb75b1c-21eb-4a55-8f0a-0937975dcfb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7', 'volume_size': 1} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:09 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 1073741824" returned: 0 in 0.631s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:09 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 Apr 16 22:25:09 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-eeba7f06-0741-4764-823e-305390ff1784-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-eeba7f06-0741-4764-823e-305390ff1784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-quobyte-eff8c65b-039f-493b-9326-0eadc39ff5f2" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-eff8c65b-039f-493b-9326-0eadc39ff5f2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-quobyte-eeba7f06-0741-4764-823e-305390ff1784" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-eeba7f06-0741-4764-823e-305390ff1784" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Deleting offline snapshot eeba7f06-0741-4764-823e-305390ff1784 of volume eff8c65b-039f-493b-9326-0eadc39ff5f2 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] snapshot_file for this snap is: volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6bbf06-26fd-43bd-bc6a-071d73fc4d49]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:09 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 Apr 16 22:25:09 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:09 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3" returned: 0 in 0.581s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.667s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2145441554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d4fb5d-86f7-42bd-8180-546d93f2b9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:06Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Creating volume d2d4fb5d-86f7-42bd-8180-546d93f2b9ea {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:09 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:09 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea 1073741824 Apr 16 22:25:09 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dee7c0-fd62-4719-9967-d17dae891c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355e57a1-8573-4dd6-ad8a-87059fe7b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:09 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 (9c0ec2ce-9cdb-4055-818a-ff842b3999e3): created successfully Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355e57a1-8573-4dd6-ad8a-87059fe7b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (f2a4d48b-2dae-4194-b87d-2bd669859635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:09 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e485c329-7132-4136-9ff2-80c1040560c4 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created volume successfully. Apr 16 22:25:09 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:10 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Flow 'volume_create_manager' (27c292fa-a7bc-4a87-98c3-f229a96408a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3b800c-234d-4e47-b890-7af4aaaea74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3b800c-234d-4e47-b890-7af4aaaea74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57746da-e37f-49e1-b1ef-2710bc2b1720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46fb6940024448785394e8d364ae9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:10Z,use_quota=True,user_id='88d4bec35d854783942d66fc77d27545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6ffeb0-20f9-480f-812e-60b3f046a252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6ffeb0-20f9-480f-812e-60b3f046a252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121fc0fd-d412-46d9-94ab-ecab06fbc840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121fc0fd-d412-46d9-94ab-ecab06fbc840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a57746da-e37f-49e1-b1ef-2710bc2b1720', 'volume_name': 'volume-a57746da-e37f-49e1-b1ef-2710bc2b1720', 'volume_size': 1, 'snapshot_id': '9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6c5134-bb8b-4292-babe-146000e8a469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6c5134-bb8b-4292-babe-146000e8a469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdc4c3-2d8b-4b7e-a2aa-dafcceb23cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:10 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Volume a57746da-e37f-49e1-b1ef-2710bc2b1720: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a57746da-e37f-49e1-b1ef-2710bc2b1720', 'volume_size': 1, 'snapshot_id': '9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa'} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784" returned: 0 in 0.734s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff8c65b-039f-493b-9326-0eadc39ff5f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0deac7-638b-4da0-b628-c51ff367fbbf]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:10 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 Apr 16 22:25:10 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:10 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea 1073741824" returned: 0 in 0.661s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:10 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea Apr 16 22:25:10 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:10 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2" returned: 0 in 0.615s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:10 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:10 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 Apr 16 22:25:10 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:11 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea" returned: 0 in 0.500s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.582s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453090107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556e1ba9-7c4c-45fb-b48d-7f2966aef9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:06Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Creating volume 556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:11 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427e1c39-2f48-45fe-96e4-749f58f7f371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:11 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 1073741824 Apr 16 22:25:11 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7826fa-ec29-4db4-96c4-f5c73167a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:11 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea (d2d4fb5d-86f7-42bd-8180-546d93f2b9ea): created successfully Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7826fa-ec29-4db4-96c4-f5c73167a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (6865315e-885a-44d5-864d-1ff820dc24d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-068ab284-28d9-4d1a-9304-4ac9480d1f82 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created volume successfully. Apr 16 22:25:11 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784" returned: 0 in 0.499s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:11 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784 Apr 16 22:25:11 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:11 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 1073741824" returned: 0 in 0.582s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:11 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 Apr 16 22:25:11 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:11 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2.eeba7f06-0741-4764-823e-305390ff1784" returned: 0 in 0.513s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-eeba7f06-0741-4764-823e-305390ff1784" released by "_delete_snapshot" :: held 2.438s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-eff8c65b-039f-493b-9326-0eadc39ff5f2" released by "delete_snapshot" :: held 2.459s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Created reservations ['cef4ea98-0278-476c-a8be-fec1bb99e469', '43ada4a0-0c5e-4dbd-b823-73440f3d9d14', '221004f1-2c56-4969-9416-5d2fd419f03e', '456f420c-e864-4b88-b917-2dab0453ae55'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:11 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Delete snapshot completed successfully. Apr 16 22:25:11 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-06024486-f1c4-4c7c-9c91-d1e9512e3812 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-eeba7f06-0741-4764-823e-305390ff1784-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:12 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0" returned: 0 in 0.492s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.366s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999976459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc200aa0-6321-478c-9095-7b4b3c049884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:07Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Creating volume cc200aa0-6321-478c-9095-7b4b3c049884 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:12 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36610b44-aed6-4477-94ec-ed6ba5004488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:12 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 1073741824 Apr 16 22:25:12 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c611be-274a-4f55-8bdc-d6f08af0290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:12 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 (556e1ba9-7c4c-45fb-b48d-7f2966aef9d0): created successfully Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c611be-274a-4f55-8bdc-d6f08af0290d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (b2a0d83e-6a2b-461d-8c23-ed77490a91d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:12 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-eb17d120-0726-4ee9-bdff-408e71a2b8ec tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created volume successfully. Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-eff8c65b-039f-493b-9326-0eadc39ff5f2-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-eff8c65b-039f-493b-9326-0eadc39ff5f2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "cinder-quobyte-eff8c65b-039f-493b-9326-0eadc39ff5f2" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-eff8c65b-039f-493b-9326-0eadc39ff5f2" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8006cd4e-30a3-4972-8dd2-86180a8d9e98]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:12 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 Apr 16 22:25:12 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:12 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 1073741824" returned: 0 in 0.609s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:12 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:12 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 Apr 16 22:25:12 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:13 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2" returned: 0 in 0.587s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:13 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2 Apr 16 22:25:13 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:13 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884" returned: 0 in 0.503s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.308s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397469882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc2b751-4c1a-4011-a4a0-2f458aaea580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a397e99e381e4075a3a7ffc761fad80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:07Z,use_quota=True,user_id='466deacbfd894bb3babe84349acaf2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Creating volume 7bc2b751-4c1a-4011-a4a0-2f458aaea580 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:13 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e24bc45-9646-40b2-99ad-914c9442d246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc200aa0-6321-478c-9095-7b4b3c049884', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:13 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 1073741824 Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9421e573-f7f2-41e0-adaf-d52a8b7307ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:13 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:13 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume volume-cc200aa0-6321-478c-9095-7b4b3c049884 (cc200aa0-6321-478c-9095-7b4b3c049884): created successfully Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9421e573-f7f2-41e0-adaf-d52a8b7307ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (52be06d1-3a52-4ab0-b3b6-212ba1fb9f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:13 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-acc40651-7c0b-440f-a11e-2de5702ff56a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created volume successfully. Apr 16 22:25:13 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-eff8c65b-039f-493b-9326-0eadc39ff5f2" returned: 0 in 0.580s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-quobyte-eff8c65b-039f-493b-9326-0eadc39ff5f2" released by "delete_volume" :: held 1.207s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Created reservations ['7a9e3ce7-5abe-42cb-8dcf-166fbd6be277', 'f83054f8-7707-4481-8055-1f627e3889eb', 'f8322fbe-f294-44b8-8920-29d65cb16ff2', '8a96a724-1d37-4b1d-9d18-5bf23d5de7e0'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:13 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:13 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:13 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 1073741824" returned: 0 in 0.624s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:13 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:14 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 Apr 16 22:25:14 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:14 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.506s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:14 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Deleted volume successfully. Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-be93f45d-b682-46cf-8445-4f14776ca376 tempest-CreateVolumesFromSnapshotTest-666871915 None] Lock "cinder-eff8c65b-039f-493b-9326-0eadc39ff5f2-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:14 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580" returned: 0 in 0.530s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.429s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-197836391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb75b1c-21eb-4a55-8f0a-0937975dcfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b903df85e40f408d993c3c03b20eb6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:09Z,use_quota=True,user_id='cf4bc8d2d57f4644b82884a9a0385668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Creating volume 6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:14 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:14 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 1073741824 Apr 16 22:25:14 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4465013-a4d4-4484-8b13-0e8b3b997d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6b17f4-afe6-4423-841a-ffdb49abed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:14 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Volume volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 (7bc2b751-4c1a-4011-a4a0-2f458aaea580): created successfully Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6b17f4-afe6-4423-841a-ffdb49abed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:14 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Flow 'volume_create_manager' (ee8df3db-fe2e-4b90-9ee4-85347df7b494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:14 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c1bbc50f-6763-4da2-8076-f498eb07ee4a tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created volume successfully. Apr 16 22:25:15 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 1073741824" returned: 0 in 0.652s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:15 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 Apr 16 22:25:15 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-7bc2b751-4c1a-4011-a4a0-2f458aaea580-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-7bc2b751-4c1a-4011-a4a0-2f458aaea580-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-quobyte-7bc2b751-4c1a-4011-a4a0-2f458aaea580" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-7bc2b751-4c1a-4011-a4a0-2f458aaea580" acquired by "delete_volume" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[303eb19d-3614-4472-8bda-ac3b7a3c830c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:15 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" returned: 0 in 0.726s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:15 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 Apr 16 22:25:15 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.868s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-quobyte-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa-a57746da-e37f-49e1-b1ef-2710bc2b1720" by "_create_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40673c4-ba20-4d40-87ff-e2cf495b922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88287d39-d870-42ff-a548-acf3e5f312e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa-a57746da-e37f-49e1-b1ef-2710bc2b1720" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Creating volume a57746da-e37f-49e1-b1ef-2710bc2b1720 from snapshot 9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa {{(pid=82650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:15 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-quobyte-a57746da-e37f-49e1-b1ef-2710bc2b1720" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:16 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Volume volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 (6eb75b1c-21eb-4a55-8f0a-0937975dcfb7): created successfully Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88287d39-d870-42ff-a548-acf3e5f312e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Flow 'volume_create_manager' (6a883488-106e-476e-92c2-a062eb90bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-a57746da-e37f-49e1-b1ef-2710bc2b1720" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] snapshot: 9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa, volume: a57746da-e37f-49e1-b1ef-2710bc2b1720, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:25:16 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e243711b-e4f8-4012-8d41-ab839d901591 tempest-VolumeDependencyTests-580761201 None] Created volume successfully. Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f708776b-4272-4ab1-a78d-6c586b42d139]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:16 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa Apr 16 22:25:16 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:16 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580" returned: 0 in 0.685s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:16 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580 Apr 16 22:25:16 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Flow 'volume_create_manager' (21fbe54c-71be-4eb5-9811-2b6595e3342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:16 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08908691-d4c9-4b90-a762-7011ccec7167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" returned: 0 in 0.682s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443d5ef8-1dc0-4157-b8c5-cc2848330211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e138519-6199-4132-b811-4c5c90b7a1f7]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08908691-d4c9-4b90-a762-7011ccec7167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2092266932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2b3b05-055a-409c-b46d-ef745e0302bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b903df85e40f408d993c3c03b20eb6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6eb75b1c-21eb-4a55-8f0a-0937975dcfb7,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:17Z,use_quota=True,user_id='cf4bc8d2d57f4644b82884a9a0385668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf04c57-f08c-4ca4-94d1-9ace9b4a27bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf04c57-f08c-4ca4-94d1-9ace9b4a27bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a2d66e-c221-46c2-a9d3-8e4dba1486bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a2d66e-c221-46c2-a9d3-8e4dba1486bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1f2b3b05-055a-409c-b46d-ef745e0302bf', 'volume_name': 'volume-1f2b3b05-055a-409c-b46d-ef745e0302bf', 'volume_size': 1, 'source_volid': '6eb75b1c-21eb-4a55-8f0a-0937975dcfb7', 'source_volstatus': 'available'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad4846b-9316-43a6-9657-9dd507bc52d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad4846b-9316-43a6-9657-9dd507bc52d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbb2bc2-be96-49c9-9b07-0f08281e45fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:16 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Volume 1f2b3b05-055a-409c-b46d-ef745e0302bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1f2b3b05-055a-409c-b46d-ef745e0302bf', 'volume_size': 1, 'source_volid': '6eb75b1c-21eb-4a55-8f0a-0937975dcfb7', 'source_volstatus': 'available'} Apr 16 22:25:16 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:16 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 Apr 16 22:25:16 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:17 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-7bc2b751-4c1a-4011-a4a0-2f458aaea580" returned: 0 in 0.563s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-7bc2b751-4c1a-4011-a4a0-2f458aaea580" released by "delete_volume" :: held 1.280s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created reservations ['7958fcff-419d-41df-b87b-a6f58e5ac6cc', '99b12f7f-d699-49ce-99e5-bb5b7347f60c', 'f03173bf-e7c8-4e71-aa06-48b6023ff80c', 'c2df2319-5fa4-45a4-9201-da05894df4e8'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:17 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:17 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:17 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211" returned: 0 in 0.543s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:17 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 Apr 16 22:25:17 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:17 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.449s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:17 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Deleted volume successfully. Apr 16 22:25:17 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-d987971f-a2c6-4af9-9ed3-4536d4779833 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-7bc2b751-4c1a-4011-a4a0-2f458aaea580-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-cc200aa0-6321-478c-9095-7b4b3c049884-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-cc200aa0-6321-478c-9095-7b4b3c049884-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-quobyte-cc200aa0-6321-478c-9095-7b4b3c049884" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:18 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-cc200aa0-6321-478c-9095-7b4b3c049884" acquired by "delete_volume" :: waited 0.017s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:18 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd4147-545e-4d0b-889e-af54134d2174]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:18 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:18 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 Apr 16 22:25:18 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:19 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884" returned: 0 in 1.236s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:19 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884 Apr 16 22:25:19 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:19 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720" returned: 0 in 2.371s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:19 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00cf38-86c1-4d83-8db0-b7da11591178]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:19 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 Apr 16 22:25:19 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:19 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:19 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-cc200aa0-6321-478c-9095-7b4b3c049884" returned: 0 in 0.563s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:19 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-cc200aa0-6321-478c-9095-7b4b3c049884" released by "delete_volume" :: held 1.848s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created reservations ['e3a1713c-e024-447e-8af7-fdc7eac3a677', '60f3499b-0d76-4c10-850e-5ce5fc51f488', '7f10c980-d18f-49da-8731-d728ccaf9ba4', '2dcf9c2e-4bcd-4674-ba25-52c2332ed328'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:20 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:20 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:20 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-quobyte-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211" returned: 0 in 0.660s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:25:20 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Converted 1024.00 MB image at 431.55 MB/s Apr 16 22:25:20 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 is being set with open permissions: ugo+rw Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0" acquired by "delete_volume" :: waited 0.032s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:20 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 Apr 16 22:25:20 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[64825544-1899-46af-a634-fd0f3172c69e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:20 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 Apr 16 22:25:20 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:20 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.549s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:20 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Deleted volume successfully. Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e60cec73-ae0c-462a-8d98-56c1072f4907 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-cc200aa0-6321-478c-9095-7b4b3c049884-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:20 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720" returned: 0 in 0.555s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-a57746da-e37f-49e1-b1ef-2710bc2b1720" released by "_copy_volume_from_snapshot" :: held 4.944s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa-a57746da-e37f-49e1-b1ef-2710bc2b1720" released by "_create_volume_from_snapshot" :: held 5.007s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:20 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.040s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.080s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:21 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Cloning volume 6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 to volume 1f2b3b05-055a-409c-b46d-ef745e0302bf Apr 16 22:25:21 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0" returned: 0 in 0.548s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdc4c3-2d8b-4b7e-a2aa-dafcceb23cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57746da-e37f-49e1-b1ef-2710bc2b1720', 'volume_size': 1, 'snapshot_id': '9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:21 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0 Apr 16 22:25:21 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816027bc-3851-4ccf-8f05-8c77eca72e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:21 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Volume volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 (a57746da-e37f-49e1-b1ef-2710bc2b1720): created successfully Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816027bc-3851-4ccf-8f05-8c77eca72e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Flow 'volume_create_manager' (27c292fa-a7bc-4a87-98c3-f229a96408a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Creating offline snapshot fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 of volume 6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6129f343-8640-4356-aae9-18e16001594d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:21 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-0397b0a1-80c3-4db4-9a02-8c479aae9ac5 tempest-SnapshotDependencyTests-1852150043 None] Created volume successfully. Apr 16 22:25:21 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 Apr 16 22:25:21 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:21 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0" returned: 0 in 0.497s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0" released by "delete_volume" :: held 1.082s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created reservations ['654fcfae-e0f3-4661-a496-33b900f85541', '5e097aa0-7e69-4714-bf6f-358f13ce2688', '74c343df-bd5f-4683-897e-415fc6b05254', '5d6b43c6-de1b-418e-ae0c-c1a4518c2b78'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:21 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:21 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:21 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" returned: 0 in 0.584s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:21 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 1G Apr 16 22:25:21 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-quobyte-443d5ef8-1dc0-4157-b8c5-cc2848330211" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-443d5ef8-1dc0-4157-b8c5-cc2848330211" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-quobyte-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Deleting offline snapshot 9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa of volume 443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] snapshot_file for this snap is: volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a09eac-a898-479b-bb6a-f3bcf90d4c2e]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:21 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:21 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa Apr 16 22:25:21 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:22 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.568s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:22 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Deleted volume successfully. Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c947ede4-d2da-42c6-8cff-eee69bd1337f tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-556e1ba9-7c4c-45fb-b48d-7f2966aef9d0-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:22 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 1G" returned: 0 in 0.703s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:22 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 Apr 16 22:25:22 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:22 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" returned: 0 in 0.636s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443d5ef8-1dc0-4157-b8c5-cc2848330211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00e5b45-7d2e-4be4-ad1b-da5a6f581e26]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-quobyte-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:22 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 Apr 16 22:25:22 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ef1161-cf89-451a-91a1-0dba380f8f36]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:22 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea Apr 16 22:25:22 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:22 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" returned: 0 in 0.551s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:22 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 is being set with open permissions: ugo+rw Apr 16 22:25:22 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:22 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 Apr 16 22:25:22 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:23 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211" returned: 0 in 0.606s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:23 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa Apr 16 22:25:23 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:23 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea" returned: 0 in 0.652s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:23 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea Apr 16 22:25:23 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:23 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" returned: 0 in 0.497s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:23 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.info Apr 16 22:25:23 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:23 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" returned: 0 in 0.559s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:23 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa Apr 16 22:25:23 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:23 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea" returned: 0 in 0.530s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea" released by "delete_volume" :: held 1.207s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created reservations ['7f6f292d-7f42-4599-a404-0cca8ddd977f', 'f62247e3-6048-4cda-b119-9e958676d7e4', 'b68d4a07-eb5c-4086-aab4-02feb982f47c', 'ca9bf609-571e-4413-be3e-9ea3723d570a'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:23 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:23 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:23 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:24 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.info" returned: 0 in 0.545s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:24 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.info is being set with open permissions: ugo+rw Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:24 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.info Apr 16 22:25:24 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:24 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211.9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" returned: 0 in 0.507s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa" released by "_delete_snapshot" :: held 2.371s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-443d5ef8-1dc0-4157-b8c5-cc2848330211" released by "delete_snapshot" :: held 2.385s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Created reservations ['650feb93-fc98-43f9-b6d1-03731ba6cdeb', 'd489e99b-9eb5-494b-8552-ba89c369fd4a', '22c3f6d7-d9fb-483e-92f9-82dd66fe41ef', 'c8836b3d-148e-4100-a2b5-756ef28959db'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:24 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Delete snapshot completed successfully. Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-7586bcda-4697-4e9a-9ac0-eae332d9d4ee tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-9fcfd3c3-8d33-45f2-ad4e-f6e14ddee0aa-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-9f269805-158b-4176-b39b-63832d868674 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:24 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:24 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:24 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.492s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:24 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Deleted volume successfully. Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-3b33227a-9e94-4dad-9a8d-e9699215a589 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-d2d4fb5d-86f7-42bd-8180-546d93f2b9ea-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:24 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.info" returned: 0 in 0.485s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-1f2b3b05-055a-409c-b46d-ef745e0302bf" by "_copy_volume_from_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-1f2b3b05-055a-409c-b46d-ef745e0302bf" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] snapshot: fc2ddba1-f33b-4b0e-a76f-6929e9c0e439, volume: 1f2b3b05-055a-409c-b46d-ef745e0302bf, {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3151c806-73d4-4025-aaf1-618a35a0c42d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:24 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 Apr 16 22:25:24 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-9c0ec2ce-9cdb-4055-818a-ff842b3999e3-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-9c0ec2ce-9cdb-4055-818a-ff842b3999e3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-quobyte-9c0ec2ce-9cdb-4055-818a-ff842b3999e3" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-9c0ec2ce-9cdb-4055-818a-ff842b3999e3" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1425046f-8760-4c63-ac90-6d428540997d]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:24 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-9f269805-158b-4176-b39b-63832d868674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.522s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG oslo_service.periodic_task [None req-9f269805-158b-4176-b39b-63832d868674 None None] Running periodic task VolumeManager._thread_info {{(pid=82650) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread count: 28 {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 16 22:25:24 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-9f269805-158b-4176-b39b-63832d868674 None None] thread info: [<_MainThread(MainThread, started 140547530358784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=82650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 16 22:25:24 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 Apr 16 22:25:24 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-443d5ef8-1dc0-4157-b8c5-cc2848330211-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-443d5ef8-1dc0-4157-b8c5-cc2848330211-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-quobyte-443d5ef8-1dc0-4157-b8c5-cc2848330211" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-443d5ef8-1dc0-4157-b8c5-cc2848330211" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b0bbcc-0855-4566-801d-2ee08ebd3df4]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:25 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" returned: 0 in 0.602s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Creating direct copy from snapshot {{(pid=82650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e352eb-6b1a-46ea-8d0f-ef33adf3634a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:25 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 Apr 16 22:25:25 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:25 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 Apr 16 22:25:25 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:25 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3" returned: 0 in 0.579s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:25 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3 Apr 16 22:25:25 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:25 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211" returned: 0 in 0.533s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:25 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211 Apr 16 22:25:25 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:25 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" returned: 0 in 0.538s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.utils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Path /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf not found in is_blk_device check {{(pid=82650) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:25 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf Apr 16 22:25:25 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:25 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-9c0ec2ce-9cdb-4055-818a-ff842b3999e3" returned: 0 in 0.468s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-9c0ec2ce-9cdb-4055-818a-ff842b3999e3" released by "delete_volume" :: held 1.092s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:25 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created reservations ['758c5c0b-e3df-49c6-875c-14fc4db61c4e', '861bf551-1ade-43f5-967f-4d032def00db', '644ff26a-265e-4252-a0d8-e450887b1465', '3de8f685-7eb7-490e-89d5-0a1d5d3e2f47'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:26 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:26 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:26 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-443d5ef8-1dc0-4157-b8c5-cc2848330211" returned: 0 in 0.517s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-443d5ef8-1dc0-4157-b8c5-cc2848330211" released by "delete_volume" :: held 1.086s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Created reservations ['f72c58d8-0172-42ae-a64a-352dc14fcfcc', 'c0cf4a4e-e585-4a30-8118-ae913fc3705a', '14c9ea1f-3157-4e93-8364-f52cb5d11ca5', '21d6cb94-57d0-46de-a0c3-cb52302a30b5'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:26 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:26 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:26 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:27 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.348s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "cinder-quobyte-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:27 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Deleted volume successfully. Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-1554ec6f-f950-4c3b-9e30-8aeea5b7190c tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-9c0ec2ce-9cdb-4055-818a-ff842b3999e3-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f" acquired by "delete_volume" :: waited 0.088s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d6ae66-4972-4132-bdf4-d152e725b493]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-a57746da-e37f-49e1-b1ef-2710bc2b1720-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-a57746da-e37f-49e1-b1ef-2710bc2b1720-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "cinder-quobyte-a57746da-e37f-49e1-b1ef-2710bc2b1720" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:27 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f Apr 16 22:25:27 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-a57746da-e37f-49e1-b1ef-2710bc2b1720" acquired by "delete_volume" :: waited 0.018s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[21923bca-b127-47dd-868a-5db6593ba6a2]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:27 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:27 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 1.657s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:28 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Deleted volume successfully. Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-aa2fe1fb-e0a9-4fb0-89b1-e1983d26ddb5 tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-443d5ef8-1dc0-4157-b8c5-cc2848330211-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:28 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 Apr 16 22:25:28 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:28 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf" returned: 0 in 2.803s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e9e912-cb6d-4aec-8532-75802af84c79]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:28 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f" returned: 0 in 0.975s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:28 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 Apr 16 22:25:28 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:28 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f Apr 16 22:25:28 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:28 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720" returned: 0 in 0.913s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:28 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:28 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720 Apr 16 22:25:28 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:29 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f" returned: 0 in 0.497s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-quobyte-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f" released by "delete_volume" :: held 1.537s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Created reservations ['792866ad-a434-462f-9517-e8f18ae6f2fc', '4f184ec1-a8c0-48e7-9134-f8b08b680121', 'c7293baf-8d1f-486c-9993-229c35d18925', '8e2b66a0-9c10-4b0d-9c91-ad7256ffc4e3'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:29 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:29 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:29 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" returned: 0 in 0.771s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.image.image_utils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7, size 1024.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf {{(pid=82650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:25:29 devstack cinder-volume[82650]: INFO cinder.image.image_utils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Converted 1024.00 MB image at 365.24 MB/s Apr 16 22:25:29 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf is being set with open permissions: ugo+rw Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:29 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf Apr 16 22:25:29 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:29 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-a57746da-e37f-49e1-b1ef-2710bc2b1720" returned: 0 in 0.612s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-quobyte-a57746da-e37f-49e1-b1ef-2710bc2b1720" released by "delete_volume" :: held 1.571s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Created reservations ['12a91e3a-5ec4-4ea3-991d-34ad41614357', 'c4d12401-26d8-4874-9c2d-90cadbde114e', '31f5a6c3-200e-4337-84b6-7ef82df86323', '6258a5ff-d00d-4b11-8a29-ae601a9fc086'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:29 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:29 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:29 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.553s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:29 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Deleted volume successfully. Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c9b62931-69f3-4940-87a0-0eb1a4734f04 tempest-CreateVolumesFromSourceVolumeTest-974433526 None] Lock "cinder-d18c0c6b-ae4e-4df5-aeba-4c0e3b156e6f-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:29 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf" returned: 0 in 0.610s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-1f2b3b05-055a-409c-b46d-ef745e0302bf" released by "_copy_volume_from_snapshot" :: held 5.380s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Deleting offline snapshot fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 of volume 6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] snapshot_file for this snap is: volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e4b455-d88d-478f-b11a-71ff9d73e203]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:29 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:30 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.535s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:30 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:30 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Deleted volume successfully. Apr 16 22:25:30 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-a835033d-7ba8-449f-bb9b-f5f748ce228b tempest-SnapshotDependencyTests-1852150043 None] Lock "cinder-a57746da-e37f-49e1-b1ef-2710bc2b1720-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:30 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 Apr 16 22:25:30 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:30 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" returned: 0 in 0.683s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:30 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:25:30 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d1157a-7364-4720-bc91-6d082a045fb7]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:30 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:30 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 Apr 16 22:25:30 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:31 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" returned: 0 in 0.612s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:31 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 Apr 16 22:25:31 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Flow 'volume_create_manager' (cfd0b987-4079-41ab-afd5-b45bf08d7f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e129b4e8-83d0-4b28-a2b5-77e460bb9d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e129b4e8-83d0-4b28-a2b5-77e460bb9d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e4ce9b-aa1d-4456-93cb-883fe2ba706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01e12dbf24bff96987b04930dcfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:32Z,use_quota=True,user_id='e8bbeb0d7d2e447dbb6b825f9b8d23b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1f256a-5684-41e6-ba98-d40a5c5e1798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1f256a-5684-41e6-ba98-d40a5c5e1798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813a4e4d-7e6f-4bcd-b9b7-85f6232f03df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:31 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813a4e4d-7e6f-4bcd-b9b7-85f6232f03df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e4ce9b-aa1d-4456-93cb-883fe2ba706a', 'volume_name': 'volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2c0f44-f188-4b38-96c1-8c04449c823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2c0f44-f188-4b38-96c1-8c04449c823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1431cc8a-46dd-49c6-918b-527bb839863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:31 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Volume d0e4ce9b-aa1d-4456-93cb-883fe2ba706a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a', 'volume_size': 1} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" returned: 0 in 0.744s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:31 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:32 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439 Apr 16 22:25:32 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:32 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7.fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" returned: 0 in 0.581s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-fc2ddba1-f33b-4b0e-a76f-6929e9c0e439" released by "_delete_snapshot" :: held 2.682s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.625s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e4ce9b-aa1d-4456-93cb-883fe2ba706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01e12dbf24bff96987b04930dcfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:32Z,use_quota=True,user_id='e8bbeb0d7d2e447dbb6b825f9b8d23b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Creating volume d0e4ce9b-aa1d-4456-93cb-883fe2ba706a {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:32 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbb2bc2-be96-49c9-9b07-0f08281e45fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2b3b05-055a-409c-b46d-ef745e0302bf', 'volume_size': 1, 'source_volid': '6eb75b1c-21eb-4a55-8f0a-0937975dcfb7', 'source_volstatus': 'available'}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc997f01-c5b2-4e63-9998-8f69b96e6821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:32 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a 1073741824 Apr 16 22:25:32 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:32 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Volume volume-1f2b3b05-055a-409c-b46d-ef745e0302bf (1f2b3b05-055a-409c-b46d-ef745e0302bf): created successfully Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc997f01-c5b2-4e63-9998-8f69b96e6821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:32 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Flow 'volume_create_manager' (21fbe54c-71be-4eb5-9811-2b6595e3342a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:32 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-4eb0aaa6-392a-4607-884d-d162366fc629 tempest-VolumeDependencyTests-580761201 None] Created volume successfully. Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4567b6c5-54d6-463d-a6ca-7ae88268280c]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:33 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 Apr 16 22:25:33 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:33 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a 1073741824" returned: 0 in 0.703s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:33 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a Apr 16 22:25:33 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:33 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" returned: 0 in 0.627s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:33 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7 Apr 16 22:25:33 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:33 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a" returned: 0 in 0.509s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1431cc8a-46dd-49c6-918b-527bb839863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bd2182-536b-4669-b5fa-777b57405ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:33 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Volume volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a (d0e4ce9b-aa1d-4456-93cb-883fe2ba706a): created successfully Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bd2182-536b-4669-b5fa-777b57405ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:33 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Flow 'volume_create_manager' (cfd0b987-4079-41ab-afd5-b45bf08d7f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:33 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-bf31148f-fe76-49a6-9258-2aedb050a263 tempest-CinderUnicodeTest-197416447 None] Created volume successfully. Apr 16 22:25:34 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" returned: 0 in 0.471s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7" released by "delete_volume" :: held 1.141s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Created reservations ['2c18b0ff-6cb1-40cd-b16a-6f2f0f2a194d', 'bc58ce34-ebc4-45b8-b592-e8f1ffdbf7a2', 'ce80ed12-c9da-4ed7-bf4a-e2dcec628315', '6dbbc28e-1b97-47f0-b8bc-4902063d9dab'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Flow 'volume_create_manager' (79917f35-f2ba-4750-b2c8-32288cebfd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6052101d-37b0-4788-bc65-7df67a191430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6052101d-37b0-4788-bc65-7df67a191430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-117399637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4df99a-99b8-4d38-b0d9-638c5118f7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01e12dbf24bff96987b04930dcfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:34Z,use_quota=True,user_id='e8bbeb0d7d2e447dbb6b825f9b8d23b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7a0939-9afb-4518-9d93-2baa0c6ea438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7a0939-9afb-4518-9d93-2baa0c6ea438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8422f269-813d-4583-9736-8a9c1040be6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8422f269-813d-4583-9736-8a9c1040be6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4df99a-99b8-4d38-b0d9-638c5118f7bf', 'volume_name': 'volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8056cf-0922-4ff4-9ac1-3e3d41159065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8056cf-0922-4ff4-9ac1-3e3d41159065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a694a51-cb03-4ee0-bebc-c0363d4952b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:34 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Volume de4df99a-99b8-4d38-b0d9-638c5118f7bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf', 'volume_size': 1} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:25:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-117399637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4df99a-99b8-4d38-b0d9-638c5118f7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01e12dbf24bff96987b04930dcfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:25:34Z,use_quota=True,user_id='e8bbeb0d7d2e447dbb6b825f9b8d23b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9247ddc6-43b5-428d-a212-b4a47352d080),volume_type_id=9247ddc6-43b5-428d-a212-b4a47352d080)}" {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Creating volume de4df99a-99b8-4d38-b0d9-638c5118f7bf {{(pid=82650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Selected osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 as target Quobyte volume. {{(pid=82650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:25:34 devstack cinder-volume[82650]: INFO cinder.volume.drivers.remotefs [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] casted to osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39 Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf 1073741824 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:34 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:34 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf 1073741824 Apr 16 22:25:34 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:34 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:34 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:35 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.673s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:35 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:35 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Deleted volume successfully. Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=183,cinder:UPDATE=284,cinder:DELETE=23,cinder:INSERT=60 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf 1073741824" returned: 0 in 0.716s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=188,cinder:UPDATE=238,cinder:INSERT=63,cinder:DELETE=25 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f99d9669-4417-4da4-ac34-98619a901717 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-6eb75b1c-21eb-4a55-8f0a-0937975dcfb7-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:35 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf Apr 16 22:25:35 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-1f2b3b05-055a-409c-b46d-ef745e0302bf-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-1f2b3b05-055a-409c-b46d-ef745e0302bf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-1f2b3b05-055a-409c-b46d-ef745e0302bf" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-1f2b3b05-055a-409c-b46d-ef745e0302bf" acquired by "delete_volume" :: waited 0.021s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a883b1-e1b5-46b6-94c0-b13803968479]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:35 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf Apr 16 22:25:35 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:35 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf" returned: 0 in 0.533s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'} {{(pid=82650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a694a51-cb03-4ee0-bebc-c0363d4952b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf', 'volume_size': 1}' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac55f874-6b91-42f0-b773-90b8980262ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:25:35 devstack cinder-volume[82650]: INFO cinder.volume.flows.manager.create_volume [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Volume volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf (de4df99a-99b8-4d38-b0d9-638c5118f7bf): created successfully Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac55f874-6b91-42f0-b773-90b8980262ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82650) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Flow 'volume_create_manager' (79917f35-f2ba-4750-b2c8-32288cebfd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82650) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:25:35 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f4faa849-8e80-4233-be02-a70d76bf55dd tempest-CinderUnicodeTest-197416447 None] Created volume successfully. Apr 16 22:25:35 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf" returned: 0 in 0.545s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:35 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:36 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf Apr 16 22:25:36 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:36 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-1f2b3b05-055a-409c-b46d-ef745e0302bf" returned: 0 in 0.536s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-1f2b3b05-055a-409c-b46d-ef745e0302bf" released by "delete_volume" :: held 1.127s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Created reservations ['5ef6b679-0364-405c-8271-2cc376edfed8', 'de916965-1231-462f-a035-e48d23b7af10', '16c00a92-269b-47ae-a4cb-cd1d9e9aee74', '521bfe5c-a0d8-47b4-a060-e1b6f7fa87bd'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:36 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:36 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Creating offline snapshot 70e82b10-a726-4e02-94ef-5eeb442b1ba4 of volume de4df99a-99b8-4d38-b0d9-638c5118f7bf {{(pid=82650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[41726a97-7735-40ff-89b9-f158bdf9da7a]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:36 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:36 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf Apr 16 22:25:36 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:37 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.534s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:37 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Deleted volume successfully. Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-f1a186b5-7d3b-4013-80c2-2dc503de4cd5 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-1f2b3b05-055a-409c-b46d-ef745e0302bf-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:37 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf" returned: 0 in 0.542s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 1G {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:37 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 1G Apr 16 22:25:37 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-6fb86851-39cf-4cc5-be38-1cb143f815e9-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-6fb86851-39cf-4cc5-be38-1cb143f815e9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "cinder-quobyte-6fb86851-39cf-4cc5-be38-1cb143f815e9" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-6fb86851-39cf-4cc5-be38-1cb143f815e9" acquired by "delete_volume" :: waited 0.013s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[753bde32-1b3d-4061-a5c0-a5cdb0d971da]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:37 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:37 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 Apr 16 22:25:37 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:38 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 1G" returned: 0 in 0.600s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:38 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 Apr 16 22:25:38 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:38 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9" returned: 0 in 0.590s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:38 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9 Apr 16 22:25:38 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:38 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf -F qcow2 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4" returned: 0 in 0.559s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:38 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 is being set with open permissions: ugo+rw Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:38 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 Apr 16 22:25:38 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:38 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-6fb86851-39cf-4cc5-be38-1cb143f815e9" returned: 0 in 0.508s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-quobyte-6fb86851-39cf-4cc5-be38-1cb143f815e9" released by "delete_volume" :: held 1.124s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Created reservations ['6c2bdbb4-224b-4ad7-8ad6-3d57a6602f4a', 'd5a6bbfb-41c8-498a-995e-889d1aba531e', '124ebb79-5e24-411a-9b45-0da3b8b15ed6', 'ba215990-9f7b-49b4-91f5-c750d6a561a1'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:38 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:38 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:38 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:39 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4" returned: 0 in 0.447s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:39 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.info Apr 16 22:25:39 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:39 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.420s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:39 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Deleted volume successfully. Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-e395e486-5fb7-4378-b901-f3ed2c2887c4 tempest-VolumeDependencyTests-580761201 None] Lock "cinder-6fb86851-39cf-4cc5-be38-1cb143f815e9-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:39 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.info" returned: 0 in 0.432s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:39 devstack cinder-volume[82650]: WARNING cinder.volume.drivers.remotefs [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.info is being set with open permissions: ugo+rw Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.info {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:39 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.info Apr 16 22:25:39 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:39 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.info" returned: 0 in 0.415s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:39 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:39 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-f0dacafa-c7d0-454b-8a9c-d233f16640cc tempest-CinderUnicodeTest-197416447 None] Create snapshot completed successfully Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "cinder-70e82b10-a726-4e02-94ef-5eeb442b1ba4-delete_snapshot" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-70e82b10-a726-4e02-94ef-5eeb442b1ba4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "cinder-quobyte-de4df99a-99b8-4d38-b0d9-638c5118f7bf" by "delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-quobyte-de4df99a-99b8-4d38-b0d9-638c5118f7bf" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "cinder-quobyte-70e82b10-a726-4e02-94ef-5eeb442b1ba4" by "_delete_snapshot" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-quobyte-70e82b10-a726-4e02-94ef-5eeb442b1ba4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Deleting offline snapshot 70e82b10-a726-4e02-94ef-5eeb442b1ba4 of volume de4df99a-99b8-4d38-b0d9-638c5118f7bf {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] snapshot_file for this snap is: volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 {{(pid=82650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1e8c43-4569-4301-ac5e-d174f296cf88]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:41 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 Apr 16 22:25:41 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:41 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4" returned: 0 in 0.499s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.remotefs [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[605d3aa5-d84d-4052-ae64-b2b4befabd47]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:41 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:41 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf Apr 16 22:25:41 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:42 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf" returned: 0 in 0.644s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:42 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 Apr 16 22:25:42 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:42 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4" returned: 0 in 0.566s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:42 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:42 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4 Apr 16 22:25:42 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:43 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:43 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf.70e82b10-a726-4e02-94ef-5eeb442b1ba4" returned: 0 in 0.513s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-quobyte-70e82b10-a726-4e02-94ef-5eeb442b1ba4" released by "_delete_snapshot" :: held 2.296s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-quobyte-de4df99a-99b8-4d38-b0d9-638c5118f7bf" released by "delete_snapshot" :: held 2.310s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:43 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Created reservations ['dd51d4fb-52ec-4ee0-ab55-7211c7522a9a', 'b82e424b-cdd1-4a7f-8b3a-8d1468f79466', '033bd9dd-a515-476d-a7a5-5e4c0e498d33', 'f9faeddb-5ac5-43a4-b2be-300f7c9602fb'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:43 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Delete snapshot completed successfully. Apr 16 22:25:43 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-564073d7-0e49-4e16-89c0-6fb706658ce5 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-70e82b10-a726-4e02-94ef-5eeb442b1ba4-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "cinder-de4df99a-99b8-4d38-b0d9-638c5118f7bf-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-de4df99a-99b8-4d38-b0d9-638c5118f7bf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "cinder-quobyte-de4df99a-99b8-4d38-b0d9-638c5118f7bf" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:44 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-quobyte-de4df99a-99b8-4d38-b0d9-638c5118f7bf" acquired by "delete_volume" :: waited 0.010s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:44 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d550ac-6bcb-4d26-a990-cfef435487ce]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:44 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf Apr 16 22:25:44 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:44 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf" returned: 0 in 0.481s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:44 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:44 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf Apr 16 22:25:44 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:45 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-de4df99a-99b8-4d38-b0d9-638c5118f7bf" returned: 0 in 0.389s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-quobyte-de4df99a-99b8-4d38-b0d9-638c5118f7bf" released by "delete_volume" :: held 0.898s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Created reservations ['33844757-6262-446c-b8f4-c1b4eff212b0', '819430ad-1780-4f5c-b6fc-3446c34f4395', '09f79007-ee05-4f6d-b996-51e42a29963b', 'ab93fe9e-ad21-4867-88b7-6685ec91b060'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:45 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:45 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "cinder-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a-delete_volume" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "cinder-quobyte-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a" by "delete_volume" {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-quobyte-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a" acquired by "delete_volume" :: waited 0.008s {{(pid=82650) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77f8a0a-89bb-4a10-aaae-6b93dfff4e0b]: (4, 'qcow2') {{(pid=83570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:45 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a Apr 16 22:25:45 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:45 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.451s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:45 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Deleted volume successfully. Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-c844d628-f1ae-4620-ae14-4eb169454634 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-de4df99a-99b8-4d38-b0d9-638c5118f7bf-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:45 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a" returned: 0 in 0.469s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:45 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:45 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a Apr 16 22:25:45 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:46 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c/volume-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a" returned: 0 in 0.389s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-quobyte-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a" released by "delete_volume" :: held 0.882s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG cinder.quota [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Created reservations ['8272de6c-9147-473b-903d-9ec93856c99b', '0c1b3cb5-4057-4c4b-99b6-973d1fdb41b6', 'a01f001d-3448-4286-bc2b-4f77cd753f1c', '6ecf59e9-5211-4c95-a201-cae2d45a9184'] {{(pid=82650) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39': None} {{(pid=82650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG cinder.volume.drivers.quobyte [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e530656-7c4a-4c4b-b3a2-216dad679a39'] {{(pid=82650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.lockutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82650) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:25:46 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c Apr 16 22:25:46 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:25:46 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG oslo_concurrency.processutils [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a0a52e3a4a2bf55929ff634667dbc9c" returned: 0 in 0.475s {{(pid=82650) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG cinder.manager [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Notifying Schedulers of capabilities ... {{(pid=82650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 16 22:25:46 devstack cinder-volume[82650]: INFO cinder.volume.manager [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Deleted volume successfully. Apr 16 22:25:46 devstack cinder-volume[82650]: DEBUG cinder.coordination [None req-090c1c9b-cc1b-4f15-8362-6dcb6b80cb76 tempest-CinderUnicodeTest-197416447 None] Lock "cinder-d0e4ce9b-aa1d-4456-93cb-883fe2ba706a-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82650) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:25:56 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:SELECT=28,cinder:UPDATE=38,cinder:INSERT=14,cinder:DELETE=3 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:25:56 devstack cinder-volume[82650]: DEBUG dbcounter [-] [82650] Writing DB stats cinder:UPDATE=45,cinder:SELECT=31,cinder:INSERT=8,cinder:DELETE=3 {{(pid=82650) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}